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INTRODUCTION 


1.1. INTRODUCTION TO OPTIMIZATION TECHNIQUES 

1.1.1. An Overview 

During the last 1930s in England and early 1940s in United States, the use of 
scientific methods was extensively made to analyze optimization problems. World War II 
challenged both countries at this time to develop optimal solution for allocation, 
transportation and multi-variable type problems. The modeling techniques studied by 
operations researchers in 1940s and 1950s usually required algebra or calculus for 
solution purposes. Mathematical Programming is one of the most powerful tools for 
optimization of communication parameters and it is still used today by the researchers, to 
describe the structuring of mathematical symbols into a model or program. These 
problems first arose in the field of economics where allocation problems had been a 
subject of deep interest. 

During World War II, a group of researchers sought to solve allocation type 
problems for the United States Air Force. One of the members of this group formulated 
and devised a solution procedure in 1947 for linear programming type problems. This 
solution procedure, called the simplex method, marked the beginning of the field of study 
called Mathematical Programming. It is useful for finding an optimal solution to a 
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complex problem involving many interrelated variables. It also simplifies exposition of 
many network problems and helps in finding optimal results which management must 
implement to realize its objectives. In 1972, [TURB 1972], surveyed a large number of 
United States Corporations on their use of operation research activities. One of his 
conclusions was that individuals within organization were more often viewing decisions 
making situations as a management science type problem requiring some types of 
mathematical modelling, than ever before observed in the past. 

Markland and Newett [MARK 1 972] voiced concern in their study on the misuse 
of mathematical programming and future problems that can be caused by the ineffective 
use of management science practitioners who fail to consider implementation as a part of 
every study undertaken in management science. Some surveys [RADN 1973, GRAY 
1973, FABO 1976] sought specific information on the use of mathematical programming 
techniques. One of these surveys conducted by Fabozzi and Valaente [FABO 1976] 
examined the use of mathematical programming methodology and where in the 
organization it was used. 

A similar study was conducted by Ledbetter and Cox [LEDB 1977]. They found 
that many organizations were using the mathematical programming techniques as 
reported by Fabozzi and Valaente as well as other management science methodologies. 
An important area of development of mathematical programming concerns with the use 
of computer in operation research. More and more computer software are being 
developed every day making the computational aspects of mathematical progr ammin g 
less complex. Time-sharing and interactive computer systems are also influencing a de- 
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emphasis on computational experience and more on problem formulation. During the last 
decade, mathematical programming approaches have gained immense importance for 
solving task allocation and load balancing problems in communication systems [CHU 
1980a, CHU 1980b, MA 1982, SINC 1987, and REID 1994]. 


1 . 1 . 2 . 


Mathematical Programming Problems 


During the last decade, mathematical programming techniques have been 
recognize as the most powerful methods for modelling and analyzing several kind of 
problems. Many research problems are formulated in the form of mathematical models, 
which describe the quantitative features of all types of problems. Mathematical 
programming techniques are used for the formulation and solution of research problems 
by systematic planning of various activities. The basic problem in mathematical 
programming is to find the unknown values of some variables, which will optimize the 
value of the objective function subject to a set of constraints. Most of the mathematical 
programming problems can be formulated in the following general form [KWAK 1987]: 
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Where, 

Z = value of the objective function which measures the effectiveness of the 

decision choice, 

xj = unknown variables that are subject to the control ofthe decision maker, 

C J = 111114 P roflt contribution of an output or cost of an input which is known, 

a 'J production (or technical) coefficients that are known, and 

= available resources in limited supply. 

Production of goods, in any organization, requires productive resources, which 
are in short supply in the real world, and they are, therefore, restricted resources. These 
restricted resources are expressed as equalities or inequalities in mathematical 
programming models. The decision maker’s goal is to find the values of the decision 
variables within limits and to optimize the value ofthe objective function. 


INTRODUCTION TO DATA COMMUNICATIONS 
1-2.1. The Need of Study 

The reasons for studying data communications can be summed up in the 
occupational history of the United States. In the 1800s they were an agricultural society 
dominated by farmers. By the 1900s they had moved into an industrial society dominated 
by labor and management. Now, as they approach the twenty-first century, they clearly 
have moved into the information society, which do computers, data communications, and 
highly skilled individuals who use brainpower instead of physical power dominate. The 
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industrial society has reached its zenith, and the communication/computer era, started in 
mid 1950s, which is dubbed the information society, is advancing rapidly. 

In an information society dominated by computers and communications, value is 
increased by knowledge as well as by the speed of movement of that knowledge. This 
new information economy will completely destroy Ricardo's labor theory of value, 

because, in such a society, what increases value is not the labor of individuals, but 
information. 

The main stream of the information age is a communication network. The value 
of a high-speed data communication network that transmits knowledge/information is 
that it brings the message sender and the message receiver closer together in time. For 
example, in the 1 800s it might have taken several weeks for specific information to reach 
the United States from England. By the 1900s it could be transmitted within an hour. 
Today, with modem data communication systems, it can be transmitted within seconds. 

Finally, the transition from an industrial to an information society means that we 
have to learn many new technologically based skills. The study of data communications 
has become a basic tool that can be used throughout our lifetime. We incorporate our 
knowledge of data communications into several careers such as circuit designer, 
programmer, business system application developer, communication specialist, and 
business manager. 
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Evolution 


Today We take data communications for granted, but it was early pioneers like 
Samuel Morse, Alexander Graham Bell, and Thomas Edison who developed the basic 
electrical and electronic systems that ultimately became today's voice and data 
communication networks. 


When the telephone arrived, it became the accepted communication device that 
everyone wanted. Several technological enhancements were made in telephonic 
technology from 1837 to 1951 and it was in 1951 that the first direct long distance 
customer dialing began. The first international satellite telephone call was sent over the 
Telstar satellite in 1962. In 1963, touch-tone telephones began to be marketed. Their push 
buttons were easier to use than rotary dials, and they became quite popular. By 1965, 

there was widespread introduction of commercial international telephone service by 
satellite. 

Picture phone service, which allows users to see as well as talk with one another, 
began operating in 1969. All through the 1970s there were many arguments and court 
cases regarding the monopolistic position that AT&T held over other companies that 
wanted to offer communication services. The litigation led to the litigation led to the 
divestiture of AT&T on Januaiy 1, 1984. 

During 1983-84 the newer cellular telephone networks supplanted traditional 
radio telephone-type calls. Integrated Services Digital Networks [ISDN] began serving 
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the public in 1986. These networks allow the simultaneous transmission of voice, data, 
and video images [FITZ 1988]. 


During the 1987 there was considerable competition in both the voice and data 
communication markets as a number of independent companies began to sell 
communication services in a manner similar to that of automobile marketing. And now 
we have smaller and less expensive portable telephones to carry around everywhere. 

1-2.3* The Indian Scenario 

India is a resource rich fast developing country where telecommunication has 
passed from the stage of convenience to essentiality. Computers have entered in a big 
way in Indian society. As on March 3 1 1986, it was estimated that the country had about 
3050 super, mainframes and minis and 7000 micros and personal computers. The number 
of microcomputers and personal computers is growing fast. The idea of computer 
networking has been widely accepted in government organizations. The National 
Informatics Center [NIC] has been doing this for planning purposes to Govt, of India. 
NICNET computer and communication facilities have provided nation-wide links to 
make the computing resources available at the places from where the information 
emanates [AGAR 1995]. 



The Indian society has now clearly realized the importance of communications, 
which may be in its various forms including telephones, memorandums, telex, mail, 
reports etc. Attempts have been made by the organizations like Telecommunications 
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Research Center [TRC] to produce prototype model of several important communication 
systems. Electronic mail, facsimile equipment, modems, teletext voice mail etc. have 
been developed, integration of computer communication with special digital switches, 
ISDN, has also been tried. This has put India in the forefront of telecommunication 
services. The Govt, of India has realized that without a better and secures telecom system 
the fruits of development can never be fairly distributed, be it in education, economics, 
rural development or international trade and banking. 

The development of efficient communication systems has opened new vistas in 
electronic industries. The OSI technology is coming up fast and fiber optics technology 
has also entered into the scene. Optical fiber computer communication networks [Fibre 
L ANs] are now being developed in India. To meet the telematics challenge in the 
country, the IITs and some university departments have begun setting up facilities to train 
the scientists and the technicians, engaged in futuristic research and develop new systems 
in communication technology. 

1.3. COMMUNICATION SYSTEM 

1.3.1. Meaning of Communication System 

The on-set of the microprocessor technology has made the Communication 
System [CS] economically viable and attractive for many applications of computer. 
However, many problem areas in communication system are still in their primitive 
development stages. CS is increasingly drawing attention, yet has a meaning that is not 
understood. 
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Ill a CS several computers interconnected in some fashion such that a program or 
procedure utilizes this distributed but combined power and gets executed in real time. 
The term has different meanings with regard to different systems, because processors can 
be interconnected in many ways for various reasons. In its most general form, the word 
distribution implies that the processors are fixed in geographically separated locations. 
Occasionally, the term is also applied to an operating environment using multiple mini- 
computers not connected with each other with the help of physical communication lines 
but are connected through satellite. A user-oriented definition [BHUT 1994 , SITA 1995 ] 

of distributed computing is "Multiple Computers, utilized cooperatively to solve 
problems". 

1.3.2. Main Aspects of Communication Systems 

While addressing task allocation issues in a CS, the following are important 
aspects need to be consideration: 

(i) Multiplicity of resources: There are a number of resources, in particular, 
processors. Homogeneity of physical resources is not essential. A system may have 
processors with identical characteristics and capabilities. 

(ii) Dispersion: The resources in the system are physically or logically 
distributed. AU the processors are independent and tied together by communication links. 
The communication links provide means for transferring information between the 
processors. 
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(iii) Control: All the processors in the system are autonomous and there is no 
master and slave relation among the processors. For the user, the collection of processors 
should be invisible, the multiple processor system should appear as virtual uniprocessor, 

and users need not know on which machine their programs are running and where their 
files are stored. 

(iv) Transparency: All the processors in the system are autonomous and there is 
no master-slave relationship among them. The fact there are several co-operating 
processors m the system must be invisible (transparent) to the user and a single image id 
presented to the user. The system should appear as a uniprocessor system and users need 

not know on which machine their programs are executing and where the data or files 
stored. 

(v) Flexibility: Flexibility is an important aspect of a distributed system. It 

means that should be easy to incorporate changes in a user transparent manner or with 
minimum interruption to the user. Further, in every system, new functionalities are to be 
added from time to time to make it more powerful and easy to use. Therefore, It should 
be easy to add new services to the system. 

(vi) Performance: The performance of the distributed system must be at least as 
good as a centralize system, that is when a particular application is run on distributed 
system, Its overall performance should be better than or at least equal to that of running 
the same application on a single processors system. 
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(vii) Scalability: Scalability refers to the capability of a system to adapt to 
increased service load. A distributed system must able to cope with the growth of nodes 
and users in the system. 

(vin) Security: Security must be provided in the system to prevent destruction and 
unauthorized access so that user can trust on the system and rely on it. 

1.3.3. Machine Size Vs Instruction Execution 

Communication Systems provides much faster execution by facilitating parallel 
execution of tasks. A major driving force towards distributed processing is the cost of 
small processors. Until the spread of mini computers in the early 1970s, a commonly 
accepted rule was Grosch's Law, which said, "The cost per machine instruction executed 
ls lnversel y proportional to the square of the size of the machine Grosch's Law became 

questionable in the 1970s. Even some people suggested that it had been reversed because 
the cost per instruction on some mini-computers was lower than on large computers and 
on microprocessors was lower than mini-computers. The reason is related to the use of 
Very Large Scale Integrated [VLSI] circuits, which can be mass-produced economically. 
Their development cycle is much shorter than that of large machines. 

1.3.4. The Logical Vs Physical Design 

The implementation of communication systems depends both on logical and 
physical premises. The logical functions center on the procedural design for channeling 
the flow of data and controlling the physical facility throughput of the projected system 
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configuration. The object' of the physical functions is the design of the hardware and 
hard-software [firmware] devices to provide a specific level of capability. Functions will 
be distributed both to machines in the computer center and too many machines at user 
locations. This trend of the distribution of processing is continuing because software 
usage of machine instructions per second is growing much faster than the development of 
higher speed machines. The CS is motivated by the need for cost reduction in tasks 
executing. 


1.3.5. Distributed Vs Parallel Computing 

In some computer networks, the control mechanism is mostly centralized. In 
others, they are mostly distributed. Where purely centralized control exists, loss of the 
center puts the entire network out of action. With the distributed control any portion of 
network can be destroyed and the rest will continue to function. Although computation 
speed has increased several folds over the past three decades of computing, the user 
demand for faster speeds is growing at a much faster rate. One of the approaches to meet 
the growing demand of faster computation is to use parallel processing. Parallel 
computers, which emphasize parallel processing, may be employed. Parallel computers 
are available with different architectures [FORT 1985, STON 1987, BOKH 1988] and 
divided in to three classes: array computers, pipeline computers and multiprocessor 
systems. To name a few are IBM 3081, Denelcor HEP, Cray x-MP and PARAM systems. 
All the parallel computers described above are centralized computing items and all 
hardware and software resources are housed at the same place. 
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1.3.6. Types of Communication Systems 

I.3.6.I. Horizontal Vs Vertical Distribution 

By Vertical distribution we mean that there is a hierarchy of processors, shown in 
Fig-Ll [MART 1988]. The transaction may enter and leave the computer system at the 
lowest level. The lowest level may be able to process the transaction or may execute 
certain functions and pass it up to the next level. Some, or all, transactions eventually 
reach the highest level, which will probably have access to on-line files or databases. The 
computers at the lowest level can be networked together, if data sharing is required. 


LEVEL 1 


LEVEL 2 


LEVEL 3 


lip Processors Communication Links 

Figure 1.1 Vertical Distributions 

A horizontal distribution implies that the distributed processors do not differ in 
rank. They are of equal status-peers and referred as peer-coupled systems. A transaction 
may use only one processor, although there are multiple processors available. On some 
peer-coupled systems a transaction may pass from one system to another causing 
different set of files to be updated as depicted in Fig. 1 .2 [MART 1 988]. 
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Figure 1.2 Horizontal Distributions 


1 .3.6.2. Functional Distribution Vs System Distribution 

In some distributed systems, usually vertical systems, functions are distributed, 
but not the capability to fully process entire transactions. The lower-level machines may 
be intelligent terminals or intelligent controllers in which processors are used for 
functions such as message editing, screen formatting, data collection dialogue with 
terminal operators, security, or message compaction concentration. They do not complete 
the processing of entire transactions. 

This distribution is referred as functional distribution and is contrasted with 
system distribution in which the lower-level machines are systems their own right, 
processing their own transactions, and occasionally passing transactions or da ta up the 
hierarchy to higher level machines. 
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Ill a system distribution environment the lower machines may be entirely different 
from, and incompatible with, the higher machines. In a function distribution environment, 
close cooperation between the lower-level and higher-level machines is vital. Overall 
system standards are necessaiy to govern what functions are distributed and exactly how 
the lower and higher machines form part common system architecture with appropriately 
integrated control mechanisms and software. 


1.3.7. Feature of Communication System 

Ifrere are a variety of reasons for building any communication System, some of 
them are as follows: 

(i) Computational Speedup: Computational speedup can be achieved if a particular 
computation can be partitioned into a number of sub-computations that can run 
concurrently. A distributed system may allow user to distribute the computation among 
the various sites -to run that computation concurrently. In addition, if a particular site is 

currently overloaded with the jobs, some of them may be moved to other, lightly loaded, 
sites. 



(«) Fault Tolerance: One of the real attractions of distributed processing is the 
resulting high fault tolerance. If a communication link or a site fails in a distributed 
system, the remaining sites can potentially continue operating. However, this may reduce 
the overall throughput of the system. 
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(iii) Increased Throughput: The throughput of the system is expected to increase by 
distributing the total workload to the various service stations. As in a distributed system 

there are a number of processing elements, one would hope to get more work done in 
shorter period of time. 


(iii) Communication: In the distributed system it is quite often the programs running 
at different sites need to exchange data with one another. When a number of site are 
connected to one another by a communication network, the processes at different sites 
have the opportunity to exchange the information. 

(nv) Resource Sharing: If a number of sites are connected to one another, then a user 
at one site may be able to use the resources available at another. In general, resource 
sharing in a distributed system provides mechanisms for sharing files at remote sites, 
processing information in a distributed database, printing files at remote sites, utilizing 
specialized hardware devices, and performing other operations. 

1.3.8. Application area of Communication Systems 

Distributed processing plays an important role in large data base installations 
where processing load is distributed for organizational efficiencies. Banking system, 
travel agency systems, and power control systems are few examples of distributed 
processing environment. The application that exhibits parallelism, involving enormous 
repetitive processing and / or requiring extremely fast processing in a real-time 
environment demand Communication Systems. To name a few such type of application 
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are signal processing, meteorology, image analysis, cryptography, nuclear reactor control, 
solar & radar surveillance, simulation of VLSI circuits, and industrial process monitoring. 


1.4 TASK ALLOCATION 

The task allocation in a communication system finds extensive applications in the 
faculties where large amount of data is to be processed in relatively short period of time, 
or where real-time computations are required. Meteorology, Cryptography, Image 
Analysis, Signal Processing, Solar and Radar Surveillance, Simulation of, VLSI circuits 
and Industrial process monitoring are areas of such applications. These applications 
require not only very fast computation speeds but also different strategies involving 
distributed task allocation systems. In such applications the quality of the output is 
proportional to the amount of real-time computations. 

To meet such challenging computing requirements at electrifying speeds some 
efficient task allocation strategies are required for proper utilization of such system under 
the constraints as: 

(i) Memory capacity available at each processor and 

(ii) Time constraints in executing task. 

The advent of VLSI technology resulting in low cost microprocessor has made CS 
an economic reality in today's computing environment. The modularity, flexibility and 
reliability of CS make it attractive to much type of users, and several CSs have been 
designed and implemented in recent years. 
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The first step m the distributed software engineering is to partition application 
program into a set of smaller independent tasks and allocates them to different 
processors. To enable the increasing variety of computers to communicate with one 
another, there must be rigorously defined protocols as to (i) how the Control Message 
[CM] and Data Message [DM] are exchanged in the CS and (ii) how to control the 
communication process along with the protocol definition. 

The format of the CMs, the headers and the trailers of DMs are likewise 
rigorously defined. Protocol becomes quite complex, as it is desirable that there should be 
a widely accepted standard so that all types of machines can inter communicate. 
However, many problematic areas in the CSs are still in their primitive development 
stage. Some major problems present the following widespread uses CS are: 

(i) The degradation in system throughput caused by the saturation effect, 

(ii) The difficulty in evenly utilizing each processor in the CS, 

(iii) A large gap between the engineering application requirements and existing 
distributed network architecture and 

(iv) The difficulty in verifying task allocation resulted from any allocating model. 

Communication Systems have been so complex that intuition alone is not 
sufficient to predict their performance. Therefore, mathematical modeling plays an 
important role for predicting the performance of the CS. Mathematical models of system 
performance range from relatively simple ones, whose solution can be obtained 
analytically, to the complex ones, which require simulation. 
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Assigning tasks to processors is called task allocation, which involves the 
allocation of tasks to processors in such a way that some effectiveness measures are 
optimized. If the effectiveness measure can be represented as a linear function of several 
variables subjected to a number of linear constraints involving these variables, then the 
task allocation is classified as a linear programming problem. Likewise, for the processor, 
which can perform anyone the several tasks, possibly the difference of execution, and the 
effectiveness measure is the total processing time to perform all tasks when one and only 
one task is allocated to each processor. In such cases, task allocation is classified as an 
assignment problem. Assigning “m” tasks to “n” processors, through exhaustive 
enumeration, results in n m possible ways. A general structure of task allocation is shown 
inFig.1.3. 



Figure 1.3: General Structure of Tasks Allocation 
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Shatz and Wang [SHAT 1987] studied that the problem of choosing an Optimal 
Allocation from all assignments is exponentially complex. An efficient task Allocation 
policy should avoid excessive Inter Processor Communication [IPC] and exploit the 
specific efficiencies of the processors and in case of a system having similar processor, 
the tasks or modules should be distributed as evenly as possible. The bottleneck in IPC is 
to provide linear speed up solutions with the increase in number of processors as 
suggested by Chu et al and Lint et al. [CHU 1980a, LINT 1981]. 

The strategies of task allocation on a parallel and distributed system may be done 
in any of the following ways: 

(i) Static Allocation: In static allocation when a task is assigned to processor, it 
remains there while the characteristic of the computation change, a new assignment must 
be computed. The phrase “characteristics of the computation” means the ratios of the 
times that a program spends in different parts of the program. Thus in a static allocation, 
one is interested in finding the assignment pattern that holds for the life time of a 
program, and result in the optimum value of the measure of effectiveness. 

(ii) Dynamic Allocation: In order to make the best use of resources in a distributed 

system, it is essential to reassign modules or tasks dynamically during program 

# ' 

execution, so as to the advantage of changes in the local reference patterns of the program 
[MANI 1998]. Although the dynamic allocation has potential performance advantages, 
Static allocation is easier to realize and less complex to operate. 
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1.4.1 Task Allocation Problem 

Consider a set P= (p. p 7 n, n \ n c ^ 

F 2 j P3> Pn>, ot n processors interconnected by 

communication links and a set T= {,,, , 2> t 3 , «of “m” executable tasks. Tie 

allocation of each “m” tasks to “n” available processors such that an objective cost 

function is minimized subject to the certain resource limitations and constraints imposed 
by the application or environment. 

An assignment of tasks to processors is defined by a function f, from the set of 

tasks T to the set of processors P, f: T-> P. Then the total cost or Time of an allocation x 
can be expressed as follows: 


e ij x y dji x v x kl 

k<i I <j 

where, 

l if i' h task is assigned to j th processor 
0, otherwise 

e;j = cost of executing task tj on processor pj 

Cj k = Communication between tasks tj and t k 

dji = distance between processors pj and pi 


m n 

Cost(x) = YJ^ 


M j = 1 
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1.5 


SOME RELATED APPROACHES 


Researchers have identified several approaches to the task allocation models. The 
following of them are concern with our work: 

1.5.1 Graph Theoretical Approaches 

The graph theoretical approaches suggest graphical methods to represent and 
allocate application tasks to various processors in a communication system. In most of 
the graph theoretical approaches, the solution processes begins with the abstraction of 
tasks and inter task communication cost through a graph model in which tasks are 
represented by nodes and inter task communications as weights on the non-directed edges 
connecting these nodes. By performing the min-cut algorithm the graph minimizes the 
tota! computation cost. These approaches do consider load balancing, resource limitation, 
and generalization issues without giving much consideration to the computing time and 
complexity. Graph theoretical algorithms become NP-hard for CS consisting of 
reasonable number of processors. 

^•2 The Integer Programming Approaches 

The integer programming approaches are based on the direct enumeration 
algorithms subject to the additional constraints. This allows real time embarrassments, 
and rather complicates it to be incorporated into the allocation model to meet various 
application requirements. These approaches are limited and do consider the system 



resources? limitation, the amount of real time computation, and memory needed to obtain 
an optimal solution, as these grow exponential functions of the order of the problem. 

1.5.3 The Heuristic Approaches 

The heuristic approaches provide approximate solutions to task allocation and 
load balancing problems. These approaches require less computation time as compared to 
the integer programming methods and are applicable in the situations where an optimum 
solution is not achievable within the reasonable time limit. 

1.6 INTRODUCTION TO RELIABILITY 

Reliability theory has grown into an engineering science in its own right 
following the World War II. Much of the initial theory, engineering, and management 
techniques centered about hardware, however, human and procedural elements of a 
system were often included. Since the late 1960s the term software reliability has become 

popular, and now reliability theory refers to both software and hardware reliability 
[SHOO 1983], 


1.6.1 Combinational Reliability 

In performing the reliability analysis of a complex system, it is almost impossible 
to treat the system in its entirety. The logical approach is to decompose the system into 
functional entities composed of units, sub systems, or components. Each entity is 
assumed to have two states, one operational and one failed. The sub division generates a 
block-diagram or fault-tree description of system operation. Models are then formulated 
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to fit this logical structure, and the calculus of probability is used to compute the system 
reliability in terms of the sub division reliabilities. 

1.6.2 Series Configuration 

The simplest and perhaps the most common structure in reliability analysis is the 
series configuration. In the series ease the functional operation of the system depends on 
the proper operation of all system components. A series reliability configuration is 
portrayed by the block-diagram representation shown in Figure 1.4(a) and the reliability 
graph shown in Figure 1.4(b). In either case, a single path from cause to effect is created. 

Failure of any component is represented by removal of the component, which interrupts 
the path thereby causes the system to fail. 


Cause 


Unit 



few 

["Unit 

1 




n 


Block Diagram of Series with n-coraponents 
Figure 1.4(a) 


"Unitl U Unit 2 


Unit n 


Reliability Graph of a Series system with n-components 
Figure 1.4 (b) 










1.6.3 Parallel Configuration 

In many SySt6ms SeveraI si § nal P aths Perform the same operation. If the system 
configuration is such that failure of one or more paths still allows the remaining path or 

paths to perform properly, the system can be represented by a parallel model. Block 
diagram and reliability graphs for a parallel system are shown in Figures 1.5(a) and 1.5(b) 
respectively. There are “n” paths connecting input to output, and all units fail; in order to 
interrupt all the paths. This is sometimes called a redundant configuration. 


Block Diagram of Parallel System with n-components 
Figure 1.5 (a) 





Unit 1 


i*3> — 


Cause ( i:' 




J Effect 


ReliabiIit y Gra P h of a Parallel System with n- Components 

Figure 1.5 (b) ■' 

1.6.4 An-r-Out-of-n Configuration 

In many P robIems system operates if “r” out of “n” units function e.g., a 
bridge supported by “n” cables, “r” of which are necessary to support the maximum load. 
One can draw a reliability graph as an aid. Each parallel path will contain “r” different 
elements, corresponding to the combinations of “n” things “r” at a time. 


1.7 SCHEDULING POLICIES IN A CS 

The scheduling policies in a CS have two categories such as job scheduling and 
task scheduling. Job scheduling allocates independent jobs to different processors to 
optimize system performance. Task allocation scheduling requires assignment of multiple 
interdependent tasks or modules of a single allocation program to minimis job 
completion time. The decision of scheduling polices is required at several levels within 
CS as shown in Fig. 1.6. At higher level the decision about local or global scheduling 
might be desired to make. The local scheduling policies decide about the allocation of a 
task or a job to the time slots for a single processor [BUCK 1979, CASA 1988]. The 
global scheduling relates to the problem of deciding where jobs or tasks [ROTI 1994] 
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run. In the next lower level is the choice between static and dynamic in a global 
scheduling. Static scheduling is prior assignments tasks to the processors where the 
allocation does not change during the lifetime of tasks. While in dynamic scheduling the 
allocation decision is made during execution of tasks. Further there are two type of 
dynamic scheduling: centralized and decentralized. If there is a single decision point, the 
dynamic scheduling is known as centralized and if the decision-making is spread 
throughout the system it is known as de-centralized. 



Figure 1.6: Taxonomy of Scheduling 
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1.8. DEFINITIONS, ASSUMPTIONS AND NOTATIONS 



1.8.1 Definitions 

(i) Inter Task communication Time: The Inter Task Communication Time t ik of the 
interacting task's t; and t k depends on the period in which data units exchanged between 
them during the time execution. 

(ii) Execution Time: Each task t; has an Execution Time ety (where 1 < i < m and 1 < 
j < n) that depends on the processor Pj to which it is assigned and the duration of work to 
be formed by the task. 

(iii) Load Balancing: Spreading the total load of a program / application on the 
available processing elements as evenly as possible is referred to as load balancing. 

1.8.2. Assumptions 

To cope up with the real life problems and to keep the algorithms reasonable in 

;u 

. II i 

size the following assumptions are made: Lf i 

(i) The number of tasks to be allocated is more than the number of processors, as 
normally is the case, in the real life CSs. 

(ii) Whenever two or more tasks are assigned to the same processor the Inter 
Tasks Communication Time between them is assumed to be zero. 

(iii) 'Whenever two or more tasks are assigned to the Inter Processor Distance 
between them is assumed to be zero. 

(iv) If a task is not executable on a certain processor due to absence of some 
resources, the Execution Time of the task is taken to be infinite (oo). 
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1.8.3 Notations 


r 


CTMQ 


CRMQ 


CURMQ 


ETMQ 


EURMQ 


IPROD 


MCTQ 


NETMQ 

NERMQ 

NEURMQ 


PCOMB 


posy 


TCOMB() 


NCTM (,) 

pet() 

itctmQ 




Communication Time 


Communication Time Matrix of Order mxm 
Time of execution of the i** 1 task on the j 1 * 1 processor 
Communication Reliability matrix of order mxm 
Communication Reliability 
Communication Unreliability 
Communication unreliability Matrix of order mxm 


Execution Time 


Execution Time Matrix of order mxn 
Execution Unreliability 
Execution Unreliability Matrix of order mxm 
Total number of assignments (Combinations) 
Number of Tasks 


Number of Processors 


An array to store Maximum Communication Time 


Counter for Allocation 


Modified Execution Time Matrix of order nxn 


Modified Execution Reliability matrix of order nxn 

Modified Execution Unreliability Matrix of order nxn 

Set of Processors {pi, p 2 , p 3 , ,p n } 

An Array to store processors combinations 

A matrix to sore the positions of communication time on 
the bases of MCT( ). 

Set of task {t u t 2 , t m } 

Assigned Tasks 

An Array to store tasks combinations 
Non-Assigned Tasks 

Modified Communication Time Matrix of order nxn 
An array to store processor wise execution Time 


Inter tasks Communication Time Matrix of order mxn 





f'l’ . , 






BS 


I 


: 


T,: 
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ipdmQ 
ITCT 
ITCTPD 
itctpd( ) 

pet O 


TETMQ 
TWM () 


Inter tasks Processors distance Matrix of order nxn 
Inter tasks Communication time 

Inter task communication time with processor distance 

An array to store processor wise communication time with 
Processor distance 

An array to store inter processor communication time 
Task Execution Time 

Task Execution Time matrix of order m x n 
Task Weight Matrix of order m 


1.9 ORGANIZATION OF THE THESIS 

The First chapter of this thesis entitled “TO STUDY AND ANALYSIS OF 
OPTIMIZATION TECHNIQUES AND THEIR APPLICATION TO EVOLVE SOME 
ALGORITHM TO PERFORMANCE ENHANCEMENT OF COMMUNICATION 
SYSTEM” is devoted to the introductoiy background of the topic in optimization 
techniques, communication systems, task allocation and other issues directly related to 
the work. A sequential historical introduction to the optimization has been described in 
detaiJs. Various aspects of the optimization have been mentioned. This chapter contains 
the different techniques of the optimization such as, Graph theoretic approaches. Integer 
programming approaches and many more. A brief overview of the communication 
system has been given to understand the basics of it. Assignment problem or let us say 
task assignment problem in these systems, is discussed and also some of the related 
concept has been included. In order to complete this piece of research we use number of 
definitions, assumptions and notations, all such definitions, assumptions and notations, 
which are used throughout the thesis has been put together and listed in this chapter. 
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Finally, the organization of the thesis, include the chapter wise brief summary of the 
present work has been mentioned in this chapter. 

Task assignment of any communication system is a most computing interesting 
and demandable research problem. Various methodologies and techniques are available 
in the literature to solve such problems. As it is the primary for researchers to known 
about related methodology and techniques. 

The Second Chapter of this thesis is a collection of all such research work, which 
is available in the literature, and directly-indirectly correlate to our work. We have 
categories them in two groups such as commonly adopted approaches and consideration 
of a particular issue. In commonly adopted approaches we have considered the Branch 
and Bound methods. Dynamic Programming, Decomposition approach, Genetic 
algorithmic approach, Heuristic approaches, Integer Programming approaches. Network 
Partitioning algorithm. Problem Reduction method, Petri Net modeling & Reliability 
evaluation and Shortest Path algorithmic method. On the other hand for consideration of 
a particular issue, we have chosen the precedence constraints, particular architecture 
consideration and reliability evaluation. 

The Third Chapter of the thesis is the important and main, as it include all five 
research problems. The general Motivation for the present research has been written 
briefly. The Objective, Technique, Computational Algorithm, Implementation and 
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Conclusion of each problem are mentioned in this chapter. The Details of each problem is 
as mentioned below: 


In the Problem I, the assignment problems in communication systems are one of 
major factor to determine the performance of such systems. The present piece of research 
problem suggests an exhaustive search approach to obtain the optimal time for optimally 
assigning the tasks to the processors of communication system. Here we define an index 
that is based on the time for the execution of task to various processors and also 
communication time amongst the tasks. The computational algorithm of the approach and 
its implementation are mentioned. The results are shown in tabular form as well as 
graphical form. This study is capable to deal all such real life situations, where the tasks 
are more than the number of processors. The developed algorithm is coded into C++ and 
several sets of data have been tested to verify the effectiveness of the algorithm. 

The title of the Problem - II is Optimizing the time of CS: Matrix Partitioning 
Approach. The performance analysis of any communication system has an important 
area of research these days. The assignment problems in communication systems are one 
of the major problems to determine the performance of these systems. The present piece 
of research problem - II suggests a matrix partitioning approach to assign all the tasks to 
the available processors of the system. Here we have chosen such a problem in which the 
tasks are more as compared to the processors of the system. It contains the computational 
algorithm of the technique and its implementation. This piece of research is capable to 
deal all such real life situations, where the tasks, which are to be executed on the 
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processors of the communication systems, are more than the number of processors of that 
system. This technique does not require adding dummy processors. The developed 
algorithm is coded into C++. The several sets of input data have been tested to verify the 
effectiveness of the algorithm. 

In the Problem - III, a new approach for assignment in co mmuni cation system 
based on tasks weight matrix partitioning has been considered. This suggests an efficient 
algorithm for communication system. The problem chosen, in which tlie number of tasks 
is more than the number of processors in the system, as it is most of the time the case of 
real life situation. The tasks are allocated to the processor in such a way that to suit the 
desired execution requirement of the tasks. The model addressed here is based on the 
consideration of task execution time and task weights. The method is presented in 
algorithmic form and implemented on the several sets of input data to test the 
performance and effectiveness of the algorithm. The developed algorithm is coded into 
C++. 

In the Problem - IV, we have used the Matrix partitioning technique to improve 
the reliability of communication system. It is almost impossible that the communication 
systems has to execute only as many tasks as the number of processors available in the 
system. That means the number of tasks, which are to be executed on the communication 
systems, shall be the more as compared to the number of processors in the systems. The 
problem of execution of "m" tasks to "n" processors (m > n) in a communication systems 
is addressed here through an efficient algorithm for the task execution in a 
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communication system. The execution reliabilities of the tasks on different processors 
have taken into consideration while preparing the algorithm to such a case. The model 
discussed here is based on the consideration of execution unreliability’s of the tasks to the 
processors. Keeping in view we suggested an efficient method to assign all the tasks as 
per the required availability of processors so that none of the tasks get remains 
unexecuted and the present approach does not require to adding dummy processors. The 
several sets of input data are considered to test the effectiveness and efficiency of the 
algorithm. It is found that the algorithm is suitable for arbitrary number of processor with 
the random program structure and workable in all the cases. 

Our day-to-day experience reveals that processor distance influences the overall 
task completion cost in any communication system, for instance, in the case of 
telecommunication network. It is well known fact that a person has to pay more for 
talking to person sitting at a long distant place. The case of Communication System is 
similar to that of a telecommunication network in this aspect. In a system, a task is 
allocated to a processor in such a way that extensive Inter Task Communication is 
avoided and the capabilities of the processor suit to the execution requirements of the 
task. 

The model discussed in the Problem - V provide an optimal solution for assigning 
a set of “m” tasks of a program to a set of “n” processors where m > n in a 
Communication System with the goal to maximize the overall throughput of the system 
and allocated load on all the processors should be balanced. The present allocation policy 
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invokes; stepwise modification of execution and communication matrices by making the 
dusters tasks. Some of the tasks may not involve in any cluster, those tasks treated as 
independent tasks. The mathematical programming approach has been used to determine 
the optimal allocation of tasks. The several sets of input data are considered to test the 
complexity and efficiency of the algorithm. It is found that the algorithm is suitable for 

arbitrary number of processor with the random program structure and workable in all the 
cases. 

In the Fourth Chapter, as we all know that research is an on going process and 
there is no last limit so that we have coin some of the new research problems, each are to 
be solved by the future researcher. Keeping these things in mind, the last chapter of this 
thesis contains the future scope of this research area and new research problem along 
with the suggestions for the researchers. 

During the period of this research work some of the research papers have been 
presented in various seminar and conferences. Two research papers are published in 
Journal (Copies of both papers are appended at the end of the thesis). And also some of 
research papers have been sent for the publication in various journals. A combined list of 
such papers has been mentioned in this chapter. During this research work we have gone 
through large number of research papers, books, monographs, Ph. D. thesis etc. so that in 
the last of the thesis a list of in alphabetic order of such research material has been 
attached. 
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SURVEY OF THE LITERATURE 

2.1 AN OVERVIEW 

Over the past few years a number of studies in optimization techniques and their 
applications to Communication System (CS) have led to the identification of several 
challenging problems. One of these problems is optimally assigning the tasks to the 

i 

i 

processors in the CS. In such system, it is essential to assign each task to the processor j 

whose characteristic are more suitable for the execution of the task. Availability of j 

information at geographically dispersed locations and the need of its transmission from 
one source to another have also led to the development of CS. 

The task allocation problem in a CS may either be static or dynamic. If the 

allocation is static the information regarding over all costs of a hardware configuration is j 

j 

1 

known before hand. When a task is assign to a particular processor, it stays on that 

* 

processor during its life time. The problem of assigning m tasks to n processors, where m , 

> n as normally is the case, in the real life is a complex one. The complexity may be 
reduced by an efficient task partitioning strategy [BERG 1987]. In case of dynamic 
allocation the tasks or modules can reassign dynamically during program execution, so as 
to the advantage of changes in the local reference patterns of the program [MANI 1998]. 

Although the dynamic allocation has potential performance advantages, static allocation 
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is easier to realize and less complex to operate. Recently, Zhou, Zhibo, Zhou, Tong and 
Jinxiang Wan § [ZHOU 2007] have discussed the bit error rate performance of an 
Invariant Delay Multiple Access DCSK (IDMA-DCSK) Communication System over 
multi path fading channels. They have established the close relation between theoretical 
and the simulation results. Ha, C and Kuo, W. [HA 2006] has also presented the multi- 
path heuristic for redundancy allocation. Onishi, J., Kimura, S., James, R.J.W., 
Nakagawa, Y., [ONIS 2007] has solved the redundancy allocation problem by using 
surrogate constraint method. A through survey of the related literature reveals that the 
earlier researches can be classified in the following two major categories 

• Commonly Adopted Approaches 

• Consideration of a Particular Issue 

2.2 COMMONLY ADOPTED APPROACHES 

2.2.1 Branch -and - Bound Methods 

Branch - and -Bound technique is very popular and widely adopted tec hni que 
among the researchers. There exist several algorithms based on this tec hni que for task 
allocation problem [AROR 1980, MA 1984, SINC 1987]. An optimal task allocation 
strategy with main concern of maximizing reliability and considering communication 
cost as the constraint function for a distributed database management system has been 
reported in [VERM 1997]. The model is converted into a state space search tree and 
Branch- and -Bound technique is used to achieve the optimum results. This approach has 
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been adopted for optimizing the distributed execution of join queries by Reid [REID 
1994]. 

2.2.2 Dynamic Programming 

Dynamic programming is an algorithm design method that can be used when the 
solution to a problem may be viewed as the result of a sequence of decisions. The main 
feature of this technique is that it often drastically reduces the amount of enumeration by 
avoiding the enumeration of some decision sequences that can not possibly be optimal. 
This approach aims at finding the optimal sequence of decision employing the principal 
of optimality. Dynamic programming based solution procedure can be regarded as 
recursive optimization because the decisions, leading to an optimal solution, are made 
one at a time. A number of research papers based on dynamic programming approach are 
available in the literature of task allocation problem in CS. Employing this approach, 
Bokhari devised a shortest tree algorithm that runs in o(mn 2 ) time for the assignment of 
'm’ modules to n’ processors [BOKH 1981a]. A relationship between module allocation 
and non - serial dynamic programming has been established by Rosenthal [ROSE 1982], 
Considering cost and reliability aspects, Ashrafi et al [ASHR 1992] developed 
optimization models for selection of programs. Dynamic programming technique is 
applied by Ferman Dez-Baca [FERN 1989] for obtaining the optimal assignment through 
local search. 


2.2.3 Decomposition Approach 

The reliability evaluation of complex networks using decomposition method is 
also one of the important techniques. The reliability of an oriented type-I network is 
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computed by Nakazawa [NAKA 1976] by decomposing the network into short-and-open- 
removed sub networks according to its keystone line called a removable line. In an 
another paper [NAKA 1977] the type-I of networks is extended to types-II, II & III and 
equivalence of one non oriented line and one pair of oriented lines with equal 1 -reliability 
is proved for types I, II & III. It is also proved that the type III networks have to be 
transformed into a Boolean expression and then the Boolean decomposition method 
[NAKA 1977] can be applied. A network [NAKA 1978] is represented by matrices which 
is suitable for computer use. The criteria for removable lines of Complex networks are 
proved. It is also proved that there are always removable lines of complex networks 
except oriented type III one, using the matrix expression [NAKA 1981], For determining 
the conditional success events Aggarwal et al [AGGA 1982 ] evolved a technique using 
both the node removal and connection multiplication methods for path enumeration. Li et 
al [LI 1992] suggested an algorithm for optimization of large-system reliability with the 
help of decomposition method. 

2.2.4 Genetic Algorithmic Approach 

This optimization approach is a heuristic optimization technique, which includes 
simulated annealing. Tabu searched an evolutionary strategy [REEV 1993]. Coit and 
Smith [COIT 1996] developed a specific genetic algorithm to analyze series-paralleled 
system and to determine the optimal design configuration where redundancy allocation 
problem for a series-parallel system had a specified number of sub systems and for each 
sub system, there are multiple component choices which can be selected and used in 
parallel. For those system designed using off- the- shelf component types, with known 
cost, reliability and weight, the system design and component selection become a 
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combinational optimization problem. They [COIT 1998a] also presented an algorithm to 
solve the redundancy allocation problem when the objective is to maximize a lower 
percentile of the system time- to- failure distribution. Levitin et al [LEVI 1998] discussed 
a redundancy optimization problem to multi-static systems. Here the systems and their 
components have the range of performance levels. Dengiz et al [DENG 1997] used the 
similar approach to solve the all-terminal network design problem when considering cost 
and reliability. Genetic algorithm was also used in optimization of system reliability 
[KUMA 1995b, PAIN 1995], while Kumar et al [KUMA 1995a] worked on the 
topological design for such systems. Exploring Genetic Programming and Boosting 
Techniques to Model Software Reliability has been studied by Costa and E.O. de Souza, 
G.A., Pozo, A.T.R., Vergilio, S.R. [COST 2007], 

2.2.5 Heuristic Approach 

Heuristic Algorithm has also played a vital role for providing solutions to 
different types of problems. Several research papers [DENG 1997, LU 1986, WARD 
1984, PRIC 1984, WILL 1983, ALFO 1988, HWAN 1993, EFE 1982, AROR 1980] have 
been reported in the literature regarding heuristic approaches for task allocation problem 
of these systems. The use of CS has been rapidly increasing in order to share expensive 
hardware and software resource and provides access to main systems from the distant 
locations. Dengiz et al [DENG 1997] suggested a heuristic algorithm inspired by 
evolutionary approach to solve the all terminal network design problem when considering 
cost and reliability. Kartik and Murthy [KART 1995] provided a heuristic algorithm to 
find an optimal and sub optimal task allocation in redundant distributed computing 
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systems, to maximizing system reliability. Further it repeatedly consider all the possible 
reassignments of tasks at a time, performs the most advantages reassignments and 
terminals when no more profile reassignments is discovered. On the other hand, the 
problem of minimizing the cost by making the clusters of those tasks that is heavily 
communicating and assigning the tasks cluster to appropriate processors. On the basis of 
execution drew considerable attention [WILL 1983, PRIC 1984, WARD 1984]. Some 
heuristic approaches for task scheduling based on characterization of inter module 
communications [LAN 1985] and reliability maximization [HWAN 1993] in the 
distributed computing system also deserves mention. The heuristic load balancing 
approaches [BOLC 1983, YANG 1987] suggested reducing the number of tasks by 
forming task clusters equal to the number of processors. This reduction is accomplished 
by fusing those tasks between them data exchanges are maximum. The task-clusters so 
formed are assigned to the processors. Finally tasks are shifted from the heavily loaded 
processors to the minimally loaded processors to balance the load on all the processors. 
Liu X. et al [LIU 1999] has presented a study of building systems from components to 
answer the questions related the configuration of components and performance relation 
with monolithic system. They has also discussed the generality of the technique with 
regard to systems other than CS. Wang, N, Lu, J.C. and Kvam, P [WANG 2007] has also 
given the reliability modeling in spatially distributed logistics systems. Another simple 
heuristic algorithm for generating all minimal paths has been suggested by Yen Wei 
Chang [YEN 2007]. 
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2.2.6 Integer Programming Approach 

A task allocation model becomes more significant and realistic when it 
incorporates real- time constraints such as inter-processor communication, memory 
limitations of each processor, etc. For the task allocation problems, Integer Programming 
is a useful and exhaustive approach as it is capable to reflect real- life situations of 
distributed processing and simplicity in application. A number of researchers have 
worked on task allocation problems employing this technique to determine the optimum 
solution [MA 1982, DESS 1980, CHU 1980a]. A model based on this approach is 
developed by Chu for optimum file allocation in a multiple computer system [CHU 
1969]. Another similar approach for data file allocation has been reported by R. 
Marcogliese and Novarese [MARC 1981]. 

2.2.7 Network Flow and Network Partitioning Algorithm 

Network Flow algorithm keeps an important role for the task allocation problems. 
Stone used this technique for the task allocation in the multiprocessor systems in 1977 
[STON 1977] by making use of Ford Fulkersen algorithm [FORD 1962] for finding 
maximum flows in commodity networks as modified by Edmonds and Karp [EDMO 
1972, KARZ 1974, DINI 1970]. The complexity of this algorithm is known to be O 
[(m+2) 3 ], where m is the number of tasks. This method provides no mechanism for 
representing memory size or other constraints. Wu et al [WU 1980a] employed network 
flow algorithm for task allocation and also described the partition algorithm for parallel 
and distributed processing [WU 1980b]. In another algorithm load balancing in a circuit- 
switched multi computer has been used by Bokhari [BOKH 1993]. Ke and Wang [KE 
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1997] proposed an efficient reliability evaluation algorithm accounting for imperfect 
nodes m distributed computing networks. Based on the concept of network partition, the 
algorithm exploits some simple efficient techniques to handle the unreliable nodes, for 
directly computing the network reliability expression considering imperfect nodes instead 
of using any compensating method. 

2.2.8 Problem Reduction Method 

A smaller problem can be handled more effectively in comparison to a bigger 
probiem. It is therefore, always advisable to reduce the size of a given problem, if 
possible. A task allocation problem can be simplified to a certain extent by reducing the 
size of the problem. Arora and Rana, who proposed module assignment in two processor 
distributed system [AROR 1979 ], adopted this idea for proposing the concept of 
clustering the tasks which exhibit certain peculiar behavior to reduce the problem size 
[AROR 1981]. A task is either assigns to a processor or fused with another task(s) 
depending upon some criterion. Sagar and Sarje [SAGA 1991 ] used the above technique 
for task allocation model for evolving new distributed systems. A clustering algorithm for 
assignment problem of arbitrary process systems to heterogeneous distributed computer 
system is implemented by Bowen et al [BOWE 1992 ], He showed that clustering 
algorithm exhibit better time complexity. The clustering technique used by Kim and 
Browne [KIM 1988 ] iteratively applies a critical path algorithm to transform the graph 
into a virtual architecture graph which consists of a set of linear clusters and the 
interconnection between them. A new heuristic, based on the concept of clustering, to 
allocate tasks for maximizing reliability is proposed by [SRIN 1999 ]. Based on clustering 
approach, a new multiprocessor scheduling technique named de-clustering has been 
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gi ven Sih ^ Lee t SIH 1993b]. They claimed that their de-clustering approach not 
only retains the clustering advantages but at the same time overcomes its drawbacks. 

2.2.9 Petri Net Modeling & Reliability Evaluation 

The probabilistic graphs, being static in nature can not efficient model and 
analyze the dynamic behavior of the system [JOLL 1980]. A Petri net approach 
introduced by Petri [PETR 1962] and Holt [HOLT 1978] is recognized as one ofthe most 
powerful modeling and analysis tool for a communicating processing environment. Petri 
net theoiy to model a distributed processing environment is also studied by Murata 
[MURA 1979]. Kumar and Aggarwal [KUMA 1993] suggested Petri net model for the 
evaluation of reliability for the execution of a computer program in a CS. The execution 
of a program in a distributed computing system may require access to several files 
residing at different sites and communications paths between several node pairs. Then, by 
using the ratability, firing and marking concepts of Petri net, an algorithm is developed to 
study the distributed computer program reliability and the CS reliability. Earlier Kumar et 
al [KUMA 1988, KUMA 1990] used this approach to obtain the reliability of a 
broadcasting network. Lopez [LOPE 1994] presented a model based on stochastic Petri 
net to estimate the reliability and availability of programs in a DPE. Some models [SHAT 
1992, SHAT 1989] for reliability oriented task allocation in redundant distributed 
computer system and estimating the reliability and availability of programs in a 
distributed processing environment. Recently Schnee Weiss, W.G. [SCHN 2007] 
presented a review of Petri net picture book and Petri nets for reliability modeling. The 
reliability of tree structured grid services has been studies by Yuan - Shim, Dai [YUAN 
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2006, YUAN 2007]. The study related to confidence bounds for system reliability was 
presented by Ramirez-Marquiz, J.E. and Wei, Jian [RAMI 2006]. 

2.2.10 Shortest Path Algorithmic Method 

The solution of the task allocation problem for a CS can be obtained by using the 
shortest path algorithms. Work based on such algorithms is reported in the literature 
[BOKH 1981a, PRIC 1982, TOWS 1986]. In order to apply this approach, a program 
graph is transformed into an assignment graph. For each node in the program graph, there 
exists a set of nodes corresponding to the number of processors in this assignment graph. 
The nodes and edges between them are labeled suitably depending on the method applied 
to obtain a shortest path from source- nodes to terminal- node. A shortest tree algorithm 
described in [BOKH 1981a] minimizes the sum of the execution and communication 
costs for arbitrarily connected distributed systems with arbitrarily number of processors, 
provided the interconnection pattern of modules form a tree. The objective of the study 
was to allocate the tasks, whenever possible, to the processors on which they execute 
fastest while taking into account the over head due to IPC. Dynamic prog ramming 
approach was applied for determining the shortest path and then optimal assignment of 
the tasks of a program over the processors of an inhomogeneous DCS was obtained. The 
worst- case complexity of the method is found to be o (n 3 <|> 3 ), where, ‘n’ is number of 
nodes in assignment graph and ‘<j>’ is the number of phases. Price and Pooch claimed that 
their shortest path method is applicable to all cases with the limitation that an op timal 
solution is possible in limited cases only [PRIC 1982]. The shortest path algorithm 
evaluates the set of nodes in the assignment graph corresponding to a program graph to 
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select the best possible allocation of a task to a processor. Towsley’s work [TOWS 1986] 
is a special cases where the inter task communication pattern is series parallel in nature. 

A search is made in the assignment graph for the parts of the program graph where inter- 

task communication patterns are in series parallel or tree in nature. For such inter task 

communication patterns, shortest paths are derived and these shortest paths are combined 

to get the overall shortest path of the assignment graph. In most of the other related 

studies [BOKH 1987, IQBA 1986a, IQBA 1986b, KOHL 1975, BOKH 1988], and 

optimal task assignment graph is constructed which contains as many layers as number of I 

processors. The calculation of weights of edges depends on the nature of the program 1 I 

graph and the processor mechanisms. Allocation of task interaction graphs to processor in 

heterogeneous networks is reported by Hui and Chanson [HUI 1997]. Keinghan [ KF.TN 

1971] used a form of dynamic programming approach by partitioning a chain structured 

program graph. Bhardwaj et al. [BHAR 1994] have applied a similar method for optimal 

sequencing and arrangement in distributed single level tree networks with communication 

delay. Some bottlenecks of the shortest path methods are that the assignment graph 

becomes very large and complex as the number of processors in the distributed system 

increases and subsequently number of computations increase for calculating the edge 

weights. Further to add, the entire assignment graph has to be retained in the memory | 

until the final assignment is made. Ramirez-Marquez, J.E. and Gebre, B.A., [RAMI 

2007] suggested a classification tree based approach for the development of minimal cut 

and path vectors of a capacitated network. 1 
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2.3 CONSIDERATION OF A PARTICULAR ISSUE 
2.3.1 Precedence Constraint 

Earlier task allocation models did not consider modules precedence constraints as 
one of the significant factor. However, practically, it is not possible to start execution of a 
task before the completion of another task until the task is independent. Therefore, 
besides considering load balancing and minimization ofIPC cost the precedence relation 
among task must also be taken into account. Some studies of task allocation models 
[CHOU 1986, MARK 1986] considered the precedence relation as a criterion for 
assignment. The model developed by Markencoff and Liaw [MARK 1986] is applicable 
for the problems exhibiting parallelism. The job comprising a set of tasks is modeled as a 
directed a cyclic graph. The graph has been partitioned into a set of sub graphs. Each 
directed a cyclic graph corresponds to an independent process without any data flow 
between sub graphs. The distribution of sub directed cyclic graphs, to processors, as 
evenly as possible, using branch and bound method, results in optimal assignment 
without IPC cost. The application for the response time of the threads is important rather 
than the entire application. Chu and Leung [CHU 1984b] reported an algorithm to search 
for task allocation that minimizes response time. The suggested algorithm considers the 
task replication and assignment together. Under any given task allocation process, to 
reduce response time, tasks reallocated from the longest weight processor to shortest 
weight processors until no further improvement is possible by such task reallocation. An 
extension for this algorithm with the objective of minimizing response tim e is proposed 
by Chu and Lan [CHU 1987b].The objective of task allocation is to counter balance the 
related but apposite factor of IPC cost and load balancing to achieve m aximum 
throughput and to satisfy real time constraints. 
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23,2 Particular Architecture Consideration 

The problem of assigning a set of ‘m’ tasks to a particular multiprocessor 
architecture having ‘n’ processors, where m > n, is known to be a mapping problem. This 
problem has been attempted by many researchers [BERM 1984, BERG 1985, BERG 
1987, BOKH 1987, FUKU 1987, LEE 1987, MEND 1987, MURT 1988, MURT 1989, 
SIVA 1988, SIVA 1989, SHMI 1991, CHUA 1992, LIAN 1994, OLSO 1994 ] to obtain 
efficient mapping schemes. Chuang et al [CHUA 1992] suggested a fast recognition 
complete processor allocation strategy for hypercube computers. This model referred to a 
dynamic processor allocation scheme where the search space generated is dependent 
upon the dimension of the requested sub cube dynamically, rather than being 
predetermined and fixed. Olson et al [OLSO 1994] have evolved a model for the fault- 
tolerant routing in mesh architectures for the distributed computing system. Network flow 
models of message flow in the mesh and hypercube have been developed by Bokhari 
[BOKH 1993]. Sih and Lee [SIH 1993a] assumed the target architecture for their 
proposed scheduling technique to be shared- bus multiprocessor. Another polynomial- 
time algorithm is developed for computing the distributed program reliability for star 
topologies of CS in which data files are restricted to a certain type of distribution [LIN 
1990]. 

2.3.3. Reliability Evaluation Consideration 

Distributed computer systems are increasingly being employed for critical 
applications, such as aircraft control, industrial process control, and banking systems. 
Maximizing performance has been the conventional objective in the allocation of tasks 
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for such systems. There are many measures to evaluate the performances of CS. 
Reliability of a CS is another vary important issue that need special attention [AGGA 

1982, GARC 1982> SEGE 1994 1- A reliability measure called, distributed program 
reliability, to model accurately the reliability of CS has also been reported [KUMA 

1988]. Some models of reliability oriented task allocation in redundant distributed 
computer systems [SHAT 1989. SHAT 1992] and estimating the reliability and 
availability of programs have also appeared in the literature. A 1- step algorithm GEAR 
(Generalized Evaluation Algorithm for Reliability), capable of computing several 
reliability parameters of a CS such a terminal-pair reliability, computer network 
rehability, distributed program reliability, and distributed system reliability, is also 
studied [KUMA 1993]. Software reliability allocation, based on several factors such as 
structure, utility, price, and cost, is proposed by Zahedi [ZAHE 1991]. Strategies are 
devised that achieve a maximal combination of safety and reliability [RAI 1982], 
Efficient methods to optimize the system reliability have been reported in [PAIN 1995, 
RAGH 1985]. Reliability analysis for a distributed program is mentioned in [KUMA 
1996 , KE 1997], A genetic algorithm based reliability optimization model for computer 
networks is proposed by Kumar et al [KUMA 1995a]. Further, an investigation of the 
problem of distributed- program reliability in various classes of distributed computing 
systems has been presented [LIN 1990]. Srinivasan and Jha suggested a new clustering- 
based safety and reliability driven heuristic for a heterogeneous distributed system 
[SRIN 199 9], 




PROBLEMS 

3.1 MOTIVATION 

Communication occurs between entities (such as, file transfer packages, 
browsers, electronic mail software, etc.) in different systems. An entity is anything 
capable of sending or receiving information. A system is a physical object that 
contains one or more entities, such as computers, terminals, processors etc. 
Communication systems have homogenous and/or heterogeneous processors that are 
connected through a communication links. It provides the capability for the utilization 
of remote computing resources and allow for increased level of flexibility, reliability, 
and modularity. The distributed processing environments in which services provided 
for the network reside at multiple sites. Instead of single large machine being 
responsible for all aspects of process, each separate processor handles subset In the 
distributed environments the programs or tasks are also often developed with the 
subsets of independent units under various environments. It has drawn tremendous 
attention in developing cost-effective and reliable applications to meet the desired 
requirements. Task allocation is the process of partitioning a set of programming 
modules into a number of processing groups, known as tasks, where each group 
executes on a separate processor. The general allocation problem is NP-complete. In 
these problems, suppose in any communication system there are ‘m’ tasks that are to 
be processed and it has at least ‘n’ processors which can process any of the m tasks 
but possibly in various time periods. Tasks are to be assigned to such processors so as 
to minimize the overall time to complete the execution of all ‘m’ tasks. Hungarian 
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approach [GILL 2002] is suited for solving the ^ ignme „ t ^ ^ ft . 

approach is ,o be applicable only for m-tasks the m-processora i.e. for balanced 
assignment problem. For the unbalanced assignment problem where m > „ or n > m. 

“ ,e H “ ng " ian me ' h0d SUg8est ,0 add d ™"V tasks or ptocessors to make Ac 
effectiveness matrix square. 


The best-known research problem for such systems is the assignment problem, 
in which the total system time is to be minimized. The problem finding an assignment 
of tasks to nodes that minimizes total execution and communication cost (or time) 
was elegantly tmalyzed using a network flow model and network flow algorithms by 
[STON 1977, STON 1978] and a number of other researchers [YADA 2002, YADA 
2003, KUMA 2001, SING 1999, SRIN 1999, PENG 1997, KUMA 1995a, KUMA 
1995b, KUMA 1995c, KUMA 1995d, SAGA 1991, ZAHE 1991, BACA 1989, CHU 
1969, KUMA 1999, KUMA 1996, KUMA 2002, KUMA 2006, CASA 1988, BOKH 
1979] through various different algorithms. The load-balancing algorithms or load- 
leveling algorithms are based on the intuition that, for better resoume utilization, it is 
desirable for the load in a distributed communication system to be balanced evenly. 
Thus a load-balancing algorithm tries to balance the total system load by transparently 
transferring the work load from heavily loaded nodes to lightly loaded nodes in an 
attempt to ensure good overall performance relative to some specific metric of system 
performance. When considering performance from the user point of view, the metric 
involved is often the response time of the processors. However, when performance is 
considered from the resource point of view, the metric involved is the total system 
throughput [SINH 2004], Kumar et al [KUMA 1995a] suggested a modified and 
efficient task allocation approach in which authors have optimized the overall system 
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C ° St ^ * ncdude execution and communication cost. Kumar et al [KUMA 1996] 
and Kumar [KUMA 1999] have suggested task allocation technique, which are 
dynamic in nature for optimizing the cost and reliability respectively. S. Srinivasan 
[SIRIN 1999] stated that software or a program to be run on the distributed computing 
system is called a task, which is composed of intercommunication tasks, which 
allocated to the different processor in the system. Several other methods have been 
reported m the literature, such as. Integer Programming [DESS 1980], Branch and 
Bound technique [RICH 1982], Matrix Reduction technique [SAGA 1991], 
Reliability Optimization [LIN 2002, LYU 2002] Modeling [BIER 2002, FITZ 2002]. 
THe SenCS Paraliel Redundancy-Allocation problem has been studied with different 
approaches, such as, Non-Linear techniques [TILL 1977], and Heuristic techniques 
[COIT 1 996, COIT 1 998a, COIT 1 998b, LO 1988]. 

Therefore it is recorded that the research problem for such systems is of the 
type tasks allocation problems, in which either system reliability is to be maximized 
or total system time is to be minimized or overall effectiveness of the computing 
systems is to be optimized under the pre specified constrains. Sager et al [SAGA 

I99I] discussed the allocation problem in 1991; they considered a set of tasks 
and a set of processors, which are less in comparison to the number of tasks. They 
have suggested a heuristics approach by using matrix reduction technique for the 
allocation of tasks to the various processors, and obtained optimal execution cost. 
Kumar et al [KUMA 1995c, KUMA 1996] has studied the task allocation problem for 
a set of heterogeneous processors on which the set of tasks to be allocated in such a 
way that all the tasks got executed and load on each processor also maintained. These 
models gave the total assignment cost and results were much better as compared to 
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Sagar « al [SAGA ,991]. The complexity of the algorithm is also less as they have 
mentioned the complexity comparisons to other approaches in their papers. Kumar 
[KUMA 2001] and Singh et al [SING 1999] also extended the work on tasks 
allocation problem for analyzing the various performance parameter Recently, 
Yuan-Shun and Levitin [YUAN 2007] has used optimal tesource allocation for 
maximtzmg performance and reliability in tree structured grid series. The genetic 
algorithm is used for reliability-oriented task assignment by Chin-Ching Chiu et al 
[CfflN 2006], The work related to redundancy allocation problem with a mix of 
components is studied by Onishi et al [ONIS 2007]. 
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PROBLEM-I 

AWMACH™ EVALUATION OF CS: AN EXHAUSTIVE SEARCH 
3.1.1 Objective 

Let given Communication System (CS) consists of a set P = { Pl , p2> ?3 p4? 

} of n processors, interconnected by communication links and a set T = { t,, t 2 , 
t 3 , t4,.....,t m } of m tasks. The processing Execution Time [ET] of individual tasks 
corresponding to each processor are given in the form of matrix ETM (,) of order m x 
n and the Communication Time [CT] is taken in the square symmetric matrices CTM 
(’) ° f ° rder n respectively- The functions to measure ET and CT are then formulated. 
A procedure to assign all the tasks to the processors of the communicating systems 
based on execution time is to be designed in such a way that the overall time is to be 
optimizing under the pre specified constraints. The load on each processor has been 
also taken care off in order to balance the load of each processor. 
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3.1.2 Technique 

Let the given system consists of a set P = { Pu p 2 , p 3 P4 , ..., Pn } of n processorSj 

interconnected by communication links and a set T = { t,, t 2 , t 3 , 14, ,t m } of m tasks. 

The processing execution time of individual tasks corresponding to each processor are 

glVCn in the matrix E ™ oforder m x n. The communication time is taken in the 
square symmetric matrix CTM (,) of order n. Initially, we obtain the task 
combinations in order to make the set of task(s) equals to number of processor. These 
combinations shall be n * m C m -„ (= nl , say) and to be store in TCOMB (). Then we 
obtained an index, which is based on the processing time of the tasks to the processors 
for the execution of tasks to various processors, and also time of communication 
amongst the task to each of the combination, the maximum value of the index shall 

g,Ve US the ° ptimal result The assignment of tasks to processors may be done in 
different ways. To allocate the task to one of the processors, the minimum value of 
each row and column of ETM (,) is obtained. Let min {r i} represent the minimum row 
time value corresponding to the tasks t, and min { Cj } represent the minimum column 
time value for processor Pj . These values are then replaced to 0 in ETM (,). For 
allocation purpose a modified version of row and column assignment method, namely 
Kumar et al [KUMA 1995c] is employed which allocates a task to a processor where 
rt has minimum execution time. The overall execution time [Etime] is expressed as 
the sum of execution and communication time of all the tasks as follows: 


Etime 


1 s *£ i <V, 

,=1 u '=> I j = 1 |/=1 


where, 
ET = 


t It ET ijXij 

L w l /- 1 J 
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where, xy= <[*’ ^ * tas ^ IS ass ^S ne d to j ,h processor 


0, otherwise 


, and 


CT = 


n n 


I {I CT,y, 


y=i [y=i 


y y= j 1 !f the *»«”** t0 Processor i communicate with the task assigned to processor j 

1 0, otherwise 


Index = (Etime)' 1 


3.1.3 Computational Algorithm 


To given an algorithmic representation to the technique mentioned in the 
previous section, let us consider a system in which a set of m tasks T= {t l5 1 2 , t 3 ... ,t m } 
is to be executed on a set of n available processors P= { Pl , p 2 , p 3 . . . , Pn } . 


Step- 1 : 


input: m, n, ETM (,), CTM (,), ; nar : = 0; T ass : = { } ; 


Step-2: 


Select the task to form the combinations with other task(s), (say ft t k ) & ft 
h). Store it in TCOMB(l), where 1=1(1) nl 


Step-3: 


for 1:= I to nl do 

begin 

TCOMB(l) 

Step-3.1: 

for k : = 1 to n do 
for i : = 1 to n do 

begin 

Add k* row of ETM (,) to its i th row. If all the values are become 
infinite, get next value of TCOMB (1) then repeat else Step-3 2 
end. F 

Step-3.2: 

Modify CTM (,) and, ETM (,) as follow; 

Step-3.2.1: 

for k : = 1 to n do 
for j : = 1 to n do 

begin 

Replace the corresponding values of k th row and k th column by zero in 
CTM Q and then add k th row to i th row and k 1 * 1 column to i* column 
after that delete the k th row and k th column from CTM (,). 


1 
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Step-3.2.2: 

kNow the E ™ ^ by adding k ' h row t0 ‘ ,h row a «d thereby deleting 
Step-3.2.3: 

respecdvdyf^ E ™ ° ^ C ™ ° “ NE ™ « and NCTO(,) 

end. 


Step-4: 

for k : = 1 to n do 
for j : = 1 to n do 
begin 

replaceltb^zero” ^ ^ ^ ° f NE ™ ° in ^ ‘■" d 

end. 


Step-5: 

fork : = 1 ton do 
for j : = 1 to n do 
begin 

Tnfrlnl min r m 0fjth C0,Umn (say mCk i> of NETM (,), which lies in k th row, 
and replace it by zero. 

end. 


Step-6: 

for j : = 1 to n do 
begin 

for k : = 1 to n do 
begin 

Search for a row in NETM (,), which has only one zero say. at the position 
(kj) and assign task(s) corresponding to this position. 
nar: = nar+ 1; 
far(k) : = j; 

Tass ^ = Tass U{tfc}; 

end; 

end. 


Step-7: 

for j : = 1 to n do 
begin 

for k : = 1 to n do 


begin 


O*** 

Search for a column which has only one zero entry say, at the position (k j) 

and assign task(s) corresponding to this position. 

nar : = nar + 1 ; 
far(k) : = j; 

Tass • = T ass u{tk}; 
end; 
















I 
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Step-8: 


if nar j± n 

^? k ' Up arbitr f7 zero entr y sa y= at the position (k,j) and assign task(s) 
corresponding to this position. ' ^ 

nar : = nar + l;far(k) : = j; 

Tass • T^s ^*{t|j}‘ 

else 

Check column(s) positions of zero(s) in unassigned row (s). Check the rowfs) 
or any previous assignment in the corresponding column(s). Find the 
minimum of the entire elements for the remaining rows and replace it zero and 
then go to step-6. 

Step-9: 

Evaluate Execution Time as; 

ET : = 0.0; 

for i : = 1 to n do 

ET : = ET + ET(i, far(i)) 

ETT(1):= ET 

Step-10: 

Evaluate Communication Time as; 

CT : = 0.0; 

for i = 1 to n do 

CT : = CT + CT(i, far(i)) 

CTT(1):= CT 

Step-11: 

Execution Time [Etime] and Index are thus calculated as - 
Step-11.1: 

Etime(l): = ETT(1)+ CTT(l) 

Step-11.2: 

Index(I): = 1 /Etime(l) 

Step-12: 

If 1 < nl then go to step-3. 

Step-13: 

List: Index (I); Etime (1); 

end. 

Step-14: 

Stop. 


3.1.4 Implementation 
Example-I 

Consider a system consisting of a set T = {t,, t 2 , t 3 , t 4 J of 4 tasks and a set P = 
{pi, P 2 , P 3 } of 3 processors, 
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Step- 1: Input: 4, 3 


ETM (,)= 2 

/, 12 


P, Pi Pi 

t, 8 12 7 

t 2 9 8 11 


t 4 10 11 12 


CTM (,) 


Step-2: 


tj t 2 


^3 ^4 


0 3 6 9 
t 2 3 0 4 5 
t 3 6 4 0 7 
t 4 9 5 7 0 


TCOMB(,) = 3424 2 3141 312 
_4 34232413121 


Step-3: 


Step-3. 1-3.2: 


TCOMB{\) = 


ETM(,) = 


P 1 pi pi 

to*t* 22 20 18 


NCTM (,) = 


/>! JP2 />3 

»i 0 3 6 

/2 3 0 4 

(3*/ 4 6 4 0 
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NETM (,) = 


/i 


t WT: -- ... 




/>! p 2 /?3 

8 12 7 

'2 9 8 1 1 

' 3 * 14 22 20 18 


/ 


Step-4 & 5: 

On applying modified Hungarian method devised by Kumar et a! [KUMA 
1995c] t0 assign the task > min in) from NETM Q for every i, r 13 = 7 , r22 = 8) 
r 33 - 1 8. Making r 13 = r 22 = r 33 = 0. Again min { Cj } from NETM (,) for every 
j, are c n = 8, c 22 = 0, c 33 = 0. Making c, , = 0, so that, we get, 


NETM (,) = 


n 


/3l Pi pi 

0 12 0 

'2 9 0 11 

>3 * M 22 20 0 


Step-6, 7& 8: 

After implementing assignment process, the first set of the allocation is thus 
obtained. 


Tasks 

— » 

Processors 

ET 

CT 

t. 


pi 

08 

03 

t 2 


P2 

08 

06 

h*U 

— ► 

£-3 

18 

04 


Step-9: 

ETT(l) := 34 

Step- 10 : 

CTT(l) ;= 13 

Step- 11 : 

Etirae(l) := 47 

Step- 12 : 

Index ( 1 ) := 0.02127650 
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On repeating the above process, the 


assignments and their corresponding related 


ValU6S ° fET ’ CT ’ Etime ’ and Indexe s are thus obtained, which are shown in the 
following table- 1: 


Table-1: Assignment Table 

ET CT Etime INDEX ^ASSIGNMENT-! I ASSIGNMENT-II I ASSIGNMENT-III 
34 13 47 0.02127650 Z i Z i I ~ ~ 1 

1 Pl l 2 P2 t,*t, n. 


34 17 51 0.01960780 t, p, t 2 


P2 t 3 * t, p 3 

P2 t,*t 3 p 3 


” ' 3 * 0 021,3910 ■' Pi t, p, Vl< ~ 

33 I 22 I 55 p, ~ p, Kn, p. 


34 ' 7 31 I 0 - 0 ' 960780 I •' p. t, p, Pl 


34 22 56 0.01785710 1, p , ,, p, t ,. tj R 




32 13 45 0.02222222 t 2 p 2 t 3 

32 16 48 0.02083333 t 2 p 2 t 3 

3 * 17 48 0.02083333 t 2 p 2 t 4 

51 16 47 0.02127650 t 2 p 2 14 

14 16 50 0.02000000 t 3 p 3 t, 

4 22 56 0.01785710 t, n, t. 


P3 t,* t 4 Pl 

P3 U* t, p, 

Pi t, * t 3 p 3 

Pi t 3 *t, p 3 

P2 t 2 * tj p, 






i 


■ 




ip# 

slip 


'■ r : 


J, 




WM 


- - 1 I 




ExampIe-II 

The results of a system which consist a set T = {t h t 2 , t 3 , t 4 , t 5 } of 5 tasks and : 
set P = {pi, p 2 , p 3 }, of 3 processors where, 


P, Pi Pi 


ETM (,): 


CTM (, ) = 


0 

3 

6 

9 

8 


3 

0 


6 

4 


4 0 

5 7 

6 9 


8 

9 
12 

10 
7 


‘4 

9 

5 

7 

0 

5 


12 

8 

9 


7 

11 

6 


11 12 
6 2 


8 

6 

9 

5 

0 


The following tables shows the results as obtain after implementing the present 

algorithm 


Tasks 

t * / 


-» Pr ocessors 
Pi 


'3**5 -» P 3 


18 

8 

8 


cr 

3 
6 

4 


Tos’jfo' — > Processors Etime 

-» p x 


t * / 


* 3**5 




Pi 

Pi 


47 


Index 

0.021276595 
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3.1.5 Conclusion 

The first problem of the thesis discusses an assignment model through 
optimization technique for the performance enhancement of communication system, 
hi this problem we have chosen such a communication system in which numbers of 
tasks are more than the number of processors. The present method deals the case 
when the index is based on the processing time of the tasks to the processors for the 
execution of tasks to various processors and also communication time amongst the 
tasks. The method is presented in computational algorithmic form and implemented 
on the several sets of input data to test the performance and effectiveness of the 
algorithm. The optimal result of the Example-I are shown in the following table: 

Tasks ->■ Pr ocessors Etime Ind ex 

h P3 

*2 -» P 2 45 0.02222222 

'.*'4 P, 

The graphical representation of the results mentioned in Table- 1 of Step- 12 of 
the implementation part of this paper is shown in the following graphs: 
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Graph-2: Execution Time Graph 

The following table shows the results of ExampIe-II given in its' implementation 
part of problem-I of this chapter, as obtain after implementing the present algorithm: 


Tasks 

— > 

Pr ocessors 

Etime 

Index 

*1**4 

-» 

Pi 



h 

— > 

Pi 

47 

0.0212765 

*1*U 


Pi 




3.1.5.1 Comparison 

The run time complexity of the algorithm is measured O (n * m C m .„) time. Our 
time complexity is better than O (m 2 n) of [SAGA 1991] and O (n m ) to [PENG 1997, 
RICH 1982]. The performance of the algorithm is compared with that of [SAGA 
1991] and [PENG 1997, RICH 1982] and results for complexity comparison are 


shown below: 

Taks 

°( n * m C m . n ) 

0(m 2 n) 

0(n m ) 

(jn,n) 

Pr esent - A Ig 

[SAGA1991] 

[PENGl 997, RICH! 982] 

(5,3) 

30 

75 

243 

(6,3) 

60 

108 

729 

(7,3) 

105 

147 

2187 

(8,3) 

168 

192 

6561 

(10,4) 

630 

400 

1048576 

(10,5) 

756 

500 

09765625 
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PROBLEM-II 

?TO^l?A^Sr G EXECUTION TIME 03r CS: MATRIX PARTITIONING 

At FM.1I ACH 


3.2,1 Objective 

Consider a communication system which consist a set P = {pi,p 2 , p n } of “it” 

processors, interconnected by an arbitrary network. The processors have local 
memoiy only and do not share any global memoiy. The processor graph is a 
convenient abstraction of the processors together with interconnection network. It has 
processors as nodes and there is a weighted edge and distance between two nodes if 
the corresponding processors can communicate with each other. The weight wy and 
distance dy on the edge between processors pj and pj represent the delay time involved 
in sending or receiving the message of dy length from one processor to another. In 
order to have an approximate estimate of this time, irrespective of the two processors, 
we use the average of the weights on all the edges in the processor graph. 

A set T — (ti, t 2 ,....t m } of “m” tasks is considered at hand to be executed on 
n processors. The Execution Time (ET) of these tasks on all the processors is given 
in the form of Execution Time Matrix [ETM (,)] of order mxn. The Communication 
Time (CT) is taken in the form of a symmetric matrix named as Communication Time 
Matrix [CTM (,)], which is of order m. In order to make the best use of the resources 
of the system for that we would like to distribute the load on each processor in such a 
way that allocated load on the processors should be evenly balanced. The proposed 
model discusses the following issues: 

> Developing the method to form the sub problems, 

> Formulating the method to assign all tasks. 
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> Formulating the Time function to measure ET, 

> Formulating the Time function to measure CT. 

3.2.2 Technique 

Since the numbers of task are more than the number of processors, so that we 
divide the problem of unbalanced tasks assignment in to sub problems, which 
becomes the balanced tasks assignment problems. Obtain the sum of each row and 
each column except infinity time (infinity time should be kept aside) form the ETM 
(’> md store the results in to Sum_Row() and Sum_Column(), each of them one 
dimensional arrays. Select the first set of tasks, (this set of tasks shall contain only as 
many tasks as the number of processor in the communication system) on the basis of 
minimum time against the tasks in the Sum_Row() array. Store the result in to ETM (, 

, ) a two dimensional array. Repeat the process until remaining tasks are either less 
than or equal to the number of processors. If the tasks are equal to the processors of 
the communication system then it will becomes the last sub problem, else to form the 
last P roblem we have to delete the column (processor) form ETMQ on the basis of 
Sum ColumnO array. Assignment of these tasks for each sub problem, we apply the 
Kumar et a! algorithm [KUMA 1995c]. The communication time of those tasks, 
which are allocated on the same processor, becomes zero. For each sub problem we 
calculate the exaction time and communication time of each processor and store the 
result in a linear array PET(j) and PCT(j) respectively where j= l,2,...n. Finally, sum 
up the value of PET (j) and PCT (j), (j=l,....,n) to obtain Etime. It is the total optimal 
time for the complete assignments. 

pet© = t ier,*, •’ 
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where, Xy— f h if i * task is assigned to j ^ processor ? and 
[ 0 , otherwise 


yy= J h if the task assigned to processor i communicat e with the task assigned to processor j I 

[0, otherwise I 

3 . 2.3 Computational Algorithm 

To given an algorithmic representation to the proposed method as discussed, 

we have to concentrate on such a system which consist a set P = {p,, p 2 , , Pn } of 

n processor and a set T = {tj, t 2 , ,t m } of m executable tasks which are to be 

processed by any one of the processor of the system. 

Step-1 : 

Input: m, n. ETM (,), CTMQ 

Step- 2 : 

Obtain the sum of each row of the ETMQ in such a way that, if any 
time values (s) is (are) oo then keeping it aside along with sum of that 
row (just to avoid the condition sum ET + 00 = 00. Store the results in 
one-dimensional array Sum Row (,) of order m. 

Step- 3 : 

Obtain the sum of each column of the ETM (,), in such a way that if 
any time value (s) is (are) 00 then keeping it aside along with product of 
that column (just to avoid the condition ET + 00 = 00). Store the results 
in one-dimensional array Sum _Column (,) of order n. 

Step- 4 : 

Partitioned the execution time matrix ETM (,) of order m x n in to sub 
matrices such that the order of these matrices become square i.e. 
number of row should be equal to number of column. Partitioning to be 
made as mentioned in the following steps. 

Step- 4 . 1 : 

Select the n task on basis of Sum _Row (,) array i.e. select the 
‘n’ task corresponding to most minimum sum to next minimum 
sum, if there is a tie select arbitrarily. (For the cases in which 
product is ET + 00 = 00, minimum value depends only ET and 
the impact of 00 is to be neglected. 
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Step-4.2: 

Store the result in the two dimensional array ETM (, ,) to form 
the sub matrices of the sub problems. 

Step-4.3: 

_. . tas ^ s are selected then go to step 4.7 else steps 4 4 

Step-4.4: 

Repeat the step 4.1 to 4.3 until the number of task become less 
than n. 

Step-4.5: 


Select the remaining task say r, r < n, select the r processors on 
the basis of Sum_ Column (,) array i.e. the processors 
corresponding to the most minimum sum to next minimum, if 
there is a tie select arbitrarily (for the cases in which product is 
ET + oo = oo, minimum value depend only ET and the impact of 
00 is to be neglected. 

Step-4.6: 

Store the result in the two dimensional array ETM („), which is 
a last sub problems. 

Step-4.7: 


List of all the sub problems formed through Step 4.1 to 4.6 and 
repeat step 5 to step 12 to solve each of these sub problems 

Step-5: 


Find the minimum of each row 

Step-6: 


of ETM (, ,) and replace it by 0. 


Find the minimum 

Step-7: 


of each column of ETM (, ,) and replace it by 0. 


Search for a row in ETM (, , ) which has only one zero and assign the 
task(s) corresponding to this position. Add one to the counter that is 
nar - nar + 1 and also store this position. 

Step-8: 

Search for a column in ETM (, , ) which has only one zero and assign 
the task(s) corresponding to this position. Add one to the counter that 
is nar - nar + 1 and also store this position. 

Step-9: 


Check whether nar - n if not than pickup an arbitrary 0 and assigned 
task(s) corresponding to this position. Add one to the counter that is 
nar = nar + 1 and also store this position, else, Check column (s) 
position of 0’s in unassigned row(s). Check the row(s) for any previous 
assignment in the corresponding column(s). Find the minimum of the 
entire elements for the remaining rows and replace it zero. Go to Steo- 
7, Else Step-10. 

Step- 10: 

Evaluate Execution Time [PET ( )1 
Step-11: 

Evaluate Communication Time [PCTC ( )] 

Step-12: 

Execution Time (Etime) are thus calculated as: 

Etime = PET ( ) + PCT ( ) 

Step-13: 

Stop. 
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3.2.4 Example 

C ° nSlder a communica tion system which is consisting of a set P = {p Is p 2 p 3 } 
of “n = 3” processors connected by an arbitral network. The processors only have 
locaJ memoiy and do not share any global memory. The processor connections graph 
is a depicted in figure-1 and tasks execution graph also pictorially depicted in figure- 
2. A set T - {ti, t 2 , t 3 , t A , t 5 , t 6 , t 7 , t s ,} of “m = 8” executable tasks which may be 
portion of an executable code or a data file. The communication graph is depicted in 



Figure- 1: Processors Graphs 



Figure - 2: Tasks Execution Graph 
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Step-2 

Obtain the sum of each row and column ofETM (,), as: 

Sum_Row= U t2 h U U tb h h 

14 9 6 7+oo 9 12+oo 18 7+oo 

Sum_Column= ^ 

32 + oo 20 + oo 30 + oo 



. 


Step-3 

We partitioned the matrix ETM (,) to define the first sub problem ETM (1,) by 
selecting rows corresponding t 3 , t 4 , tg and second sub problem ETM (2,) by 
selecting rows corresponding t 2 , t 5 , t 6 and on the basis of the SumColumn, by 
deleting columns corresponding p lf and after the selecting the remaining two 
tasks ti, t 7 to form the last sub problem ETM (3,), as there were only two tasks, 
for which we required two processors. So that the modified matrices are as; 

Sub Problem-I: 

Pi P2 

t 3 3 1 

ETM (1 , ) = t4 5 2 

t8 00 2 

Problem-II: 

Pi 

t 2 4 

ETM (2 , ) = t 5 3 

t6 6 

and. Sub Problem-Ill: 

P2 P3 

ETM 3( , ) = t, 3 5 

h 6 7 

Step-4 & 5: 

On applying modified Hungarian method devised by Kumar et al [KUMA 
1995c] to assign the tasks, on the basis of min {r;} and min {cj} from 
execution time matrices for every i and j. We put ry = 0 and cy = 0, for every 
i and j. So that, the modified matrices for each sub problem are mentioned 
below: 
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Sub Problem-!: 




t3 

NETM (1,) = t 4 

*8 

Sub Problem-II: 

t2 

NETM (2,) = t 5 

t6 

and, Sub Problem-Ill: 

P2 P3 

NETM (3,) = t, 0 0 

t 7 0 7 

Step-6, 7& 8: 

After implementing assignment process, the solution set, of the each of sub 
problem, the allocation is thus obtained. 

Solution for the Sub Problem-!: 


Solution for the Sub Problem-!!: 


Tasks —*■ 

Processors 

ET 

k — > 

P2 

02 

ts 

P3 

02 

tg 

Pi 

06 



Pi P2 P3 

4 0 3 
3 4 0 
0 oo 6 


Pi P2 P3 

0 0 0 

5 0 oo 

oo 0 5 
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Solution for the Sub Problem-Ill: 


Tasks — » 

Processors 

ET 

ti -+ 

P3 

05 

tj — ■> 

P2 

06 


Step-9: 


^l imP I e T ting .t, he process ’ we obtain Ae following set of complete 
assignments along with execution and communication times of each processor. 


Processor— > Tasks 

PET() 

PCT 0 

Pi -» t* t6 

11 

43 

P2 —* t2- ty ts 

10 

26 

P3— > ti; t 3 ; t 5 

9 

25 


Step- 10: 


Step-12: 


PET () 

:= 30 

PCT () 

:= 94 

Etime 

124 


Stop. 


3.2.5 Conclusion 

The model discussed in this problem provide an optimal solution for assigning 
a set of “m” tasks of a program to a set of “n” processors where m > n in a 
communication system that to minimize the overall time of the system and the load of 

a11 allocated tasks on a11 * e processors evenly balanced. The communication time and 
execution time on different processors has been obtained. 



Processors of communication system 

Pi 

P2 

P3 

Execution time of each processor PETQ 

11 

10 

09 

Communication time of each processor PCTQ 

43 

26 

25 

Total time of each processor time(,) 

54 

36 

34 
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The model addressed in this problem is based on the consideration of 
execution and communication times of the tasks to the processor. Keying in view 

we suggested a modified method to assign all the tasks as per the required availability 
of processors so that none of the msks ge, remains unexecuted and the present 
approach does not require to adding dummy processors. The algorithm is capable to 
improve the performance of the given communication system by optimaily assigning 
the tasks to vanous processors of the system. The final results of the problem 
considered in the implementation of the algorithm are mentioned as. 


Tasks 


Pr ocessors 

ET 

CT 

Ttime 


-» 

P i 

11 

43 

54 


-» 

Pz 

10 

26 

36 

, / 5 

-> 

Pz 

09 

25 

34 


The model discussed here, would be useful to the network system designer 
working m the field of distributed communication systems. The developed model is 
programmed in C++ and implemented the several sets of input data to test the 
effectiveness and efficiency of the algorithm, it is recorded that the model is suitable 
for arbitrary number of processors with the random program structure. 

3.2.5. 1 Comparison 

The run time complexity of the algorithm is measured O (6mn-n 2 ) time. Here 
it is concluded that it remains same as [KUMA 1998, YADA 2002J. Our time 
complexity is better than O (m 2 n) of [SAGA 1991] and O (n m ) to [PENG 1997, RICH 
1982]. The performance of the algorithm is compared with that of [SAGA 1991] and 
[PENG 1997, RICH 1982] and result in both cases, i.e. when tasks increases against 
the fixed processors and the case in which the tasks remain fix, while increase in 
processors are shown below: 
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Case-1 : For fixed processors n = 3 


Taks 

0(6mn~n 2 ) 

0(m 2 n) 

0(n m ) 

m 

Present- Alg 

[SAGA1991] 

[PENGl 997, RICH! 982] 

5 

81 

75 

243 

6 

99 

108 

729 

7 

117 

147 

2187 

8 

135 

192 

6561 

9 

153 

243 

19683 

10 

171 

300 

59049 


Case-2: For fixed tasks m - 10 

Pr ocessors 

0 (6mn - n 2 ) 

0(m 2 n) 

0(n m ) 

n 

Present - A Ig 

[SAGA 1991} 

! [PENG 1997 , RICH 1982] 

3 

171 

300 

59049 

4 

224 

400 

1048576 

5 

275 

500 

9765625 

6 

324 

600 

6 0466176 

7 

371 

700 

282475249 

8 

416 

800 

1073741824 

PROBLEM-m 

A NEW APPROACH FOR ASSIGNMENT 
WEIGHT 

IN CS: BASED ON TASKS 



3.3.1 Objective 

Consider a communication system which consist a set P = {pi,p 2 ,....p n } of “n” 
processors, interconnected by an arbitrary network. A set T = {t ls t 2 ,....t m } of V 
tasks is considered at hand to be executed on “n” processors. The Task Execution 
Time [TET] of these tasks on all the processors is given in the form of Task Execution 
Time Matrix [TETM (,)] of order m x n. The Task Weight (WT) are taken in the form 
of a linear array named as Task Weight Matrix [TWM (,)], which is of order m. In 
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order to make the best use of the resources of these systems for that we would like to 
distribute the load on each processor in such a way that allocated load on the 
processors should be evenly balanced. 

3.3.2 Proposed Method 

Since the number of task are more than the number of processors, so that we 
divide the problem of unbalanced tasks assignment in to sub problems, which are to 
be balanced tasks assignment problems. First of all arrange the weights of the tasks in 
descending order and store the result in a linear array namely, wt_seq(). Select the 
first set of tasks, (this set of tasks shall contain only as many tasks as the number of 
processor in the communication system) on the basis ofthe wt_seq () array. Store the 
result in to TETM ( , , ) a two dimensional array. Repeat the process until remaining 
tasks are either less than or equal to the number of processors. If the tasks are equal to 
the processors of the communication system then it will becomes the last sub 
problem, else to form the last problem we have to add dummy task (s) to make it 
square matrix. Assignment of these tasks for each sub problem, we apply the Kumar 
et al algorithm [KUMA 1995c]. For each sub problem we calculate the task exaction 

time and store the result in a linear array TET (j) where j= 1, 2 n. Finally, obtain 

the Etime, which is the product of TET (j) and WT (j), (j=l,....,n). It is the total 
optimal time for the complete assignments. 



rET ci ) =£ IlteT'jx, ; 

i*i j=i 


Etime = 


« n 


1 \'LWT ij *TET ljXj 

i=i [ y=i 


where, Xip f 1, 'if i* task is assigned to j* processor 


0 , otherwise 
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3.3.3 Algorithm 

To given an aI g° rithm ic representation to the proposed method as discussed 
above of this chapter, we consider a system which consist a set P = { Pl) p 2> ^ 

p„}of n processor and a set T = {t„ t 2 , ,,t m }of m executable tasks which 

are to be processed by any one of the processor ofthe system. 


Step-1: 

Input: m, n. TETM (,), TWM(,) 

Step-2: 

Arrange the weight of the task in descending order and store the result 
in wtseq () array. 

Step-3: 

Partitioned the execution time matrix TETM (,) of order mxnto sub 
matrices such that the order of these matrices become square i.e. 
number of row should be equal to number of column. Partitioning to be 
made as mentioned in the following steps. 

Step-4.1: 

Select the n task on basis of wt _seq (,) array i.e. select the ‘n’ 
task corresponding to most minimum weight to next minimum , 
if there is a tie select arbitrarily. 

Step-4.2: 

Store the result in the two dimensional array ETM (, ,) to form 
the matrices for the sub problems. 

Step-4.3: 

If all the tasks are selected then go to step 4.7 else steps 4 4 
Step-4.4: 

Repeat the step 4.1 to 4.3 until the number of task become less 
than n. 

Step-4.5: 

Add dummy task in order the make last sub problem as 
balanced problem. 

Step-4.6: 

Store the result in the two dimensional array TETM („), which 
is a last sub problem. 

Step-4.7: 

List of all the sub problems formed through Step 4.1 to 4.6 and 
repeat step 5 to step 1 1 to solve each of these sub problems. 

Step-5: 

Find the minimum of each row of TETM and replace it by 0. 

Step-6: 

Find the minimum of each column of TETM and replace it by 0 

Step-7: 

Search for a row in TETM, which has only one zero and assign the 
task(s) corresponding to this position. Add one to the counter that is 
nar = nar + 1 and also store this position. 
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Step-8: 

Search for a column in TETM, which has only one zero and assign the 
task(s) corresponding to this position. Add one to the counter that is 
nar - nar + 1 and also store this position. 

Step-9: 

Check whether nar = n if not than pickup an arbitrary 0 and assigned 
task(s) corresponding to this position. Add one to the counter that is 
nar . = nar + l and also store this position, else, Check column (s) 
position of 0’s in unassigned row(s). Check the row(s) for any previous 
assignment in the corresponding column(s). Find the minimum of the 
entire elements for the remaining rows and replace it zero, go to Sten- 
7; else Step- 10. 

Step- 10: 

Evaluate Task Execution Time [TET ( Y|. 

Step-11: 

Execution Total Time [Etime] is thus calculated as: 

Etime = ET * WT 
Step- 12: 

Stop. 

3.3.4 Implementation Of The Algorithm 


Consider a communication system which is consisting a set P = {p 1? p 2 , p 3 } of 
“n = 3” processors connected by an arbitrary network. A set T = {ti, t 2 , t 3 , t 4 , t 5 , t& 
t 7 , t 8 ,} of “m = 8” executable tasks which may be portion of an executable code or a 
data file. The tasks are different in nature and size so as the weights of tasks are 
defined. The weights of the tasks are given in Task Weight Matrix TWM (,) of order 1 
x 8 The execution time per unit weight of the tasks on various processor is mentioned 
in Task Execution Time Matrix, namely, TETM (,) of order 8x3. 



t. 

t 2 

b 

TETMQ = U 

ts 

U 

t 7 

t8 


Pi P2 P3 

6 3 5 

4 2 3 

3 1 2 

5 2 oo 

3 4 2 

6 oo 6 

5 6 7 

«3 2 5 
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TWMQ = 


ti 

k 

t 3 

U 

1 5 

t6 

t? 

t8 


weights 

70 

90 

30 

20 

40 

50 

60 

20 


Step-2 


The weights of the tasks are arranged in descending order and store the result 
in wt_seq () linear array. 


wt_seq= 


U ti h ts t6 tr t\ ti 

20 20 30 40 50 60 70 90 


Step-3 


We partitioned the matrix TETM (,) to define the first sub problem TETM (1,) 
by selecting rows corresponding t 4 , t g , t 3 and second sub problem TETM (2,) 
by selecting rows corresponding t 5 , t 6 , t 7 and by the selecting the remaining 
two tasks ti, t 2 , td, to form the last sub problem TETM (3,), Where as U 
represent the dummy task that is required to be adding to the last sub problem 
TETM (3,), to make it balance problem. So that the modified matrices are as; 


Sub Problem-I: 


TETM (1 ,) = 


t, 

*8 

t 3 


Pi 

5 

00 

3 


P2 

2 

2 

1 


P3 

OO 

5 

2 


Sub Problem-II: 


TETM (2,) = 


ts 

t6 

k 


Pi 

3 

6 

5 


P2 

4 


P3 

2 

6 

7 


79 


and, Sub Problem-Ill: 


TETM (3 ,) = 


Step-4 & 5: 

On applying modified Hungarian method devised by Kumar et al [KUMA 
1995c] to assign the tasks, on the basis of min {r;} and min {cj} from task 
execution time matrices for every i and j. We put ry = 0 and cy = 0, for every 

i and j. So that, the modified matrices for each sub problem are mentioned 
below: 

Sub Problem-I: 


TETM (1 ,) = 


Sub Problem-II; 


TETM (2 ,) = 


Sub Problem-Ill: 


TETM (3 , ) = 
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Step-6, 7& 8: 

After implementing assignment process, the solution set, of the each of sub 
problem, the allocation is thus obtained. 


Tasks 

— > Processors 

ET 

WT 

Total Time 

Solution for the Sub Problem-1: 

U 


p. 

5 

20 

Too 

k 

-> 

P2 

2 

20 

40 

*3 

— > 

P3 

2 

30 

60 

Average Time 

100 

Solution for the Sub Problem-II: 

t 5 


P2 

4 

40 

160 


-> 

P3 

6 

50 

300 / 

t 7 


Pi 

5 

60 

300 

Average Time 

300 

Solution for the Sub Problem-Ill: 

t. 

-> 

P2 

3 

70 

210 

h 


P3 

3 

90 

270 

Average Time 

270 


Step-9: 

After implementing the process, we obtain the following set of complete 
assignments along with execution and communication times of each processor. 


Processor—* Tasks 

PET0 

Optimal Execution Time 

Pi — > tt ; t 7 

400 


P2— > tj; t 5 ;t 8 

410 

630 

p3 -♦ t2; t 3 ; t6 

630 


Step- 10 & 11: 

Etime : = 630 

Step- 12: 

Stop. 


3.3.5 Conclusion 

The model discussed here provide an optimal solution for assigning a set of 
“m” tasks of a program to a set of “n” processors where m > n in a communication 
system that to maximize the overall time of the system and the load of all allocated 
tasks on all the processors evenly balanced. The model addressed here is based on the 
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consideration of task execution time to the processors. The task weights are also 
defined that represent their nature, size, etc. Keeping in view we suggested modified 
method to improve the performance of communication system by assigning all the 
tasks as per the required availability of processors so that none of the tasks get 
remains unexecuted and the present approach does not require to adding dummy 
processors, however dummy task may be added if the last sub problem contains less 
task as compare to processor. The final results of the problem considered in the 
implementation of the algorithm are mentioned as, 


Tasks 

— » 

Pr ocessors 

Ttime 

Etime 


-» 

P i 

400 


5 ^5 » ^8 

— > 

Pi 

410 

630 

^2 9 ^3 » ^6 

— > 

Pi 

630 



The model discussed here, would be useful to the network system designer 
working in the field of communication systems and other related systems such as 
computing system, computer communication networks, distributed systems etc. The 
developed model is programmed in C++ and implemented the several sets of input 
data to test the effectiveness and efficiency of the algorithm. It is recorded that the 
model is suitable for arbitrary number of processors with the random program 
structure. 

PROBLEM-IV 

RELIABILITY IMPROVEMENT OF CS: MATRIX PARTITIONING 
APPROACH 

3.4.1 Objective 

The objective of this problem is to maximize the total execution reliability by 
allocating all the tasks optimally to the communication system. For that purpose we 
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considered execution unreliability and uses the method of matrix partitioning. The 
Execution Unreliability (EUR) is presented by an array in the form of Execution 
Unreliability Matrix EURM (,) of order m x n. A procedure is then formulated to 
assign the tasks to the processors of the communication systems based on execution 
unreliability and is to be designed so that the overall reliability becomes optimized. 
This problem presented a modified method to assign all the tasks as per the required 
availability of processors so that none of the tasks get remains unexecuted as number 
of tasks is more than number of processors. 

3.4.2 Technique 

For developing the technique we have form the sub problems using matrix 
partitioning i.e. each of the sub problem is of the type of balanced assignment 
problem. Devising a method to assign all tasks to the processors and formulating the 
unreliability function to measure EUR. Since the number of task is more than the 
number of processors, so that we divide the problem of unbalanced tasks assignment 
in to sub problems using matrix partitioning, this gives us balanced tasks assignment 
problems. First of all obtain the product of each row and each column except, the 
position where, the unreliability is zero (zero unreliability should be kept aside with 
the product of row or column) from the EURM(,) and store the results into 
Product_Row() and Prouct_Column(), each of them are one dimensional arrays. 
Select the first set of tasks, (this set of tasks shall contain only as many tasks as the 
number of processor in the communication system) on the basis of minimum 
unreliability against the tasks in the Product_Row() array. Store the result in to 
EURM ( , , ) a two dimensional array. Repeat the process until remaining tasks are 
either less than or equal to the number of processors. If the tasks are equal to the 
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processors of the systems then it will becomes the last sub problem, else to form the 
!ast problem we have to delete the column (processor) from EURM(, ,) on the basis of 
Product_Column( ) array i.e. this set shall contain only as many processors as number 
of tasks left, so that we delete the processors that have maximum unreliability in the 
Product_Column() array. For allocation purpose a modified version of row and 
column assignment method devised by Kumar et al [KUMA 1995c] is employed 
which allocates a task to a processor where it has minimum execution unreliability. 
For each sub problem calculate the execution unreliability of each processor and store 
the result in a linear array PEUR(j) where j= 1,2,. ..n. 



PEUR(j) =fli S eur o x a } ; 

i=l M 


1 

where, Xy= Ju if i ,h task is assigned to j ,h processor ? and 
[0, otherwise 


3.4.3 Algorithm 

Consider a communication system, which consist a set P = {p,, p 2 , 

, pn}of n processor and a set T = (t b t 2 , .,t m } of m 

executable tasks which are to be processed by any one processor ofthe system. 


Step-1: 

Input: m, n. ERM (,). 

Step-2: 

Obtain the product of each row of the EURMQ in such a way that, if I 

any unreliability(ies) is (are) zero then keeping it aside along with 1 

product amount of that row (just to avoid the condition EUR *0 = 0.) 

Store the results in one-dimensional array Product _Row (,) of order m. 

Step-3: 

Obtain the product of each column of the EURM (,), in such a way that 

if any unreliability (ies) is (are) zero then keeping it aside along with I 
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product of that column (just to avoid the condition EUR *0 = 0). Store 
the results in one-dimensional array Product _Column (,) of order n. 

Step-4: 

Partitioned the execution unreliability matrix EURM (,) of order mxn 
to sub matrices such that the order of these matrices become square i.e. 
number of row should be equal to number of column. Partitioning to be 
made as mentioned in the following steps. 

Step-4.1: 

Select the n task on basis of Product _Row (,) array i.e. select 
the ‘n’ task corresponding to most minimum product to next 
minimum product, if there is a tie select arbitrarily. (For the 
cases in which product is EUR * 0, minimum value depends 
only EUR and the impact of zero is to be neglected). 

Step-4.2: 

Store the result in the two dimensional array EURM (, ,) to 
form the sub matrices of the sub problems. 

Step-4.3: 

If all the tasks are selected then go to step 4.7 else steps 4.4 
Step-4.4: 

Repeat the step 4. 1 to 4.3 until the number of task become less 
than n. 

Step-4.5: 

Select the remaining task say r, r < n, select the r processors on 
the basis of Product_ Column (,) array i.e. the processors 
corresponding to the most maximum product to next maximum, 
if there is a tie select arbitrarily (for the cases in which product 
is EUR * 0, maximum value depend only EUR and the impact 
of zero is to be neglected). 

Step-4.6: 

Store the result in the two dimensional array EURM („), which 
is a last sub problems. 

Step-4.7: 

List of all the sub problems formed through Step 4.1 to 4.6 and 
repeat step 5 to step 1 1 to solve each of these sub problems. 

Step-5: 

Find the minimum of each row of EURM (, ,) and replace it by 0. 

Step-6: 

Find the minimum of each column of EURM(, ,) and replace it by 0. 

Step-7: 

Search for a row in EURM(, ,), which has only one zero and assign the 
task(s) corresponding to this position. Add one to the counter that is 
nar = nar + 1 and also store this position. 

Step-8: 

Search for a column in EURM(, ,), which has only one zero and assign 
the task(s) corresponding to this position. Add one to the counter that 
is nar = nar + 1 and also store this position. 

Step-9: 

Check whether nar = n if not than pickup an arbitrary 0 and assigned 
task(s) corresponding to this position. Add one to the counter that is 
nar = nar + 1 and also store this position, else, Check column (s) 
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position of 0’s in unassigned row(s). Check the row(s) for any previous 
assignment in the corresponding column(s). Find the minimum of the 
entire elements for the remaining rows and replace it zero, go to Step- 
7; Else Step- 10. 

Step- 10: 

Evaluate Execution Unreliability [EUR] 

Step-11: 

Execution Reliability (Ereliability) is thus calculated as: 

Ereliability = 1 - EUR 
Step- 12: 

Stop. 

3.4.4 Implementation 
Example 


Consider a system which consists a set T = {ti, t 2 , t 3 , tt t ts} of 5 tasks and a set 


P= {p ]} p 2 , p 3 > of 3 processors, where. 


Step- 1: Input: 5, 3 


EURM{,) = 



Pi 

Pi 

P 3 

h 

0.03 

0.04 

0.06 

^2 

0.07 

0.02 

0.08 

h 

0.02 

0.09 

0.06 

h 

0.03 

0.07 

0.02 

ts 

0.08 

0.05 

0.04 


Step-2: 

Obtain the product of each row and column ofEURM (,), i .e. the products of 
each row and each column are as: 

t\ ti h u ts 

Pr oduct_ RomQ = o_oooo7 2 0.000112 0.000108 0.000042 0.000160 

P I P 2 P 3 

Product _ Column 0 = q. 0000001008 0.0000002520 0.0000002304 
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Step-3: 


We partitioned the matrix EURM (, ,) to define the first sub problem EURM (, 
,) by selecting rows corresponding to t 2 , t 3 , t 5 and second sub problem EURM 
(, ,) by selecting rows corresponding to the tasks tj, t 4 and by deleting columns 
corresponding to pi. So that the modified matrices for each sub problems are 
as; 


Sub Problem-I: 



P ' 

P 2 

Pi 

EURM (1,) = * 2 

0.07 

0.02 

0.08 

1 3 

0.02 

0.09 

0.06 

1 5 

0.08 

0.05 

0.04 


and, Sub Problem-II: 

pi J33 

EURM (2,) = t\ 0.04 0.06 
U 0.07 0.02 

Step-4 & 5: 

On applying modified Hungarian method devised by Kumar et al [KUMA 
1995c] to assign the tasks, on the basis of min {r ; } and min {cj} from 
unreliability matrices for every i andj. We put ry = 0 and cy = 0, for every i 
and j. On applying this to all sub problems, the modified matrices for each 
sub problem are mentioned below: 



pi 

P 2 

pi 

. tl 

0.07 

0.00 

0.08 

EURM{ 1 ,) = 

h 

0.00 

0.09 

0.06 

ts 

0.08 

0.05 

0.00 


pi pi 

EURM (2,) = h 0.00 0.06 
U 0.07 0.00 
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Step-6, 7&8: 


After implementing assignment process, the allocation is thus obtained. 

Tasks -» Processors EUR 

ti -> pi 0.04 

t* -» pi 0.02 

-> pi 0.02 

t* — > pi 0.02 

A -> pi 0.04 

Step-9: 

EUR := 0.0000000128 

Ereliability : = 0.9999999872 

Step- 10: 

Stop. 

3.4.5 Conclusion 

Maximizing the reliability of any system is one of the major parameter to 
enhance its performance. So that the present algorithm suggested here is capable for 
maximizing the overall reliability of communication system through task allocation. 
In these system tasks are allocated in such a way that their individual reliability of 
processing is optimized as well as it improve the overall reliability. In this approach 
not only that the loads of each processor get evenly balanced and none of the task gets 
unprocessed. This problem provide an optimal solution for assigning a set of “m” 
tasks of a program to a set of “n” processors where m > n for a communication 
system, that is to maximize the overall reliability of the system; the load of all 
allocated tasks on all the processors is evenly balanced. The execution unreliability 
and reliability of different processors has been obtained. 
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Processors 

Pi 

P2 

P3 

Execution unreliability of each processor PEUR (,) 

0.02 

0.0008 

0.0008 

Execution Unreliability [EUR] 

0 

o 

o 

o 

o 

o 

o 

o 

to 

8 

Total Reliability [EreliabilityQ] = (1-EUR) 

0.9999999872 


The final result of Example is as: 

Tasks — > Pr ocessors 
h -» P\ 

*1**2 "> P2 

*4 **i -» A 

This problem provides the optimal solution for improving the reliability and 
also deals the performance on the bases of maximizing system reliability. 

PROBLEM-V 

OPTIMIZING THE EXECUTION TIME OF CS: THROUGH CLUSTERING 
3.5.1 Objective 

The main objective of this problem is to minimize the total program execution 
period by allocating the tasks in such a way that the allocated load on each processor 
should be evenly balanced. The model utilized the mathematical programming 
technique for execution of the module considering that each module to be executed 
through all the processors. The Execution Time and Inter Tasks Communication Time 
are considered for developing the algorithm. The impact of Inter Processor Distance 
also considered and it is mentioned in the Inter Processor Distance Matrix [IPDM (,)] 
of the order n. The ET and ITCT are presented by arrays in the form Execution Time 


EUR 


ER 


0.0000000128 0.9999999872 
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Matrix [ETM (,)] of order m x n and Inter Tasks Communication Time Matrix 
[ITCTM (,)] of order m. 


3.5.2 Technique 


Since the number of task are more than the number of processors, so that it is 
required to form the clusters of tasks. To forming the cluster of tasks arrange the 
upper diagonal value of ITCTM (,) in descending order and store the result in a linear 
array maxctQ also store their respective positions in two dimensional array posQ. 
The maximum number of tasks in a cluster shell be governed by the formula nt = 
[m/n], where nt is the number of tasks in a cluster. Select the first value of maxct() 
and its corresponding positions from posQ say, (tj,t k ) and store the cl(ij) where i= 
1,2, ..no. of cluster and j=T,2,..nt). if j<nt then pickup the next value from maxct() and 
its corresponding positions from posQ say, (ti,t k ) select the task form this combination 
which not already exist in cl(ij) say, t, and store the same in cl(ij). This process 
continues until the entire cluster to be formed. Some of the tasks, which are not 
involved in any cluster, are known as isolated tasks. Assign these clusters and isolated 
tasks by using the KSY Algorithm [KUMA 1995c]. Calculate the exaction time and 
inter tasks communication time with processor distance of each processor and store 
the result in a linear array pet(j) and pitctpdQ respectively where j= l,2,...n. 

m 

pet{ i ) = ^] e ij x ij> i = l,2,....nfWhere xy = o, if tj and tj are on the same processor. 


1, otherwise 


pitctpdQ) ='£ l Cy *d v Xj ,j = 1,2, n Iwhere x; = 1, if tj is on the j th processor. 


0, otherwise 
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Finally, sum up the value of pet(j) and pitctpd(j), (j=l,....,n) and store the 
result the ttbp(j) and pickup the maximum value of ttbp(j) i.e. tostbp called as total 
optimal system time for busy period. 

3.5.3 Computational Algorithm 

The method discussed here is to determine the tasks allocations in 
communication systems based on the following components. 

Determine the initial allocation 

Determine the cluster of m-n tasks 

Determine the final allocation 

Computation the total system time of busy period. 

3.5.4 Algorithm 

To given an algorithmic representation to the technique mentioned in the 
previous section, let us consider a system in which a set T= (ti, t2, t 3 ... t m }of “m” 
tasks is to be executed on a set P= {pi, p 2 , p 3 ... p n }of “n” available processors. 

Step-1: Input: m, n;//m is the number of modules of a task, n is the number of processor// 

Input: etm(,);//matrix to hold the execution time of each task to each processor// 

Input: itctm(,);//matrix to hold the Communication time amongst the tasks// 

Step-2: maxct()<— 0;//linear array to store the inter task communication time// 

itaskO*— 0;//linear array to store the tasks for initial assignment// 

ItaskO 4 — 0;//linear array to store the remaining tasks for initial assignment// 
bmin<— 0;//Variable for selecting the best minimum// 

TassO^Oj/Zlinear array to hold the tasks in order to assignment made// 

T nO n-ass()^0;//linear array to store the non assigned tasks// 

nomade <-0;//variable for counting the number of the assignment made// 
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a!ioc()*— 0;//Iinear array to hold processor’s position in order of assignment// 

msr()<— 0;//Iinear array to hold processor mean service rate// 

trp()«— 0;//linaer array to hold the throughput of the processors// 

mst()<— 0;// linear array to hold processor mean service time // 

posQ^-0;//to dimensional array to hold to the corresponding position of maxct()// 

epos (,)<-G;// to dimensional array to hold to the position of common element // 

netm(,)<— 0;//operational matrix for execution time// 

nictmO*~~0;// operational matrix for inter task communication time // 

ttask()<— 0;//linear array to store the total number of task to the processors// 

Step-3: for i <— 1 to n do 

for j 1 ton do 

store the etm(,) in netmQ as 
netm( s )<— etm(,) 

repeat 

repeat 

for i <— 1 to n do 

for j 4 - l to n do 

store the itctmQ in nitctmQ as 
nitctmQ*- itctm(,) 

repeat 

repeat 

Step-4: set k m (m- 1 )/2 

Step-5: for i «— 1 to m do 

for j 1 to k do 

arrange the upper diagonal values of nitctmQ in non-ascending 
order and store the result in maxctQ, until j = k 

repeat 

repeat 

Step-5. 1 : for i *- ! to k do 

for j 1 to 2 do 
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store the combinations of tasks of maxctQ in pos(,) 


repeat 


repeat 

Step-5.1.1: nt<—0 

set count <— m/n 
Step-5.1.2: nt<~ count 

for i 1 to m do 

for j 1 to k do 

pick-up the maximum value of maxct() and 
check the corresponding combination in posQ, 
say(tj,t k ) 

if nt=count 

then 


store the cluster in a linear 

array clj() 

else 

if pos(i,j)<pos(i,k) 
nmax ^-pos(ij), until j=k 
repeat for i 

nmax <pos(i,k), until] =k 


endif 

check the corresponding combination of 
nmax in posQ,say(tj ? t k ), store the cluster 
in a linear array clj() 

repeat 


repeat 

nt nt+count 

Step-5. 1 .3 : set k<— (m-nt(m-nt)- 1 )/2 

Step-5.1.4: modify the pos(,) by deleting the combination and reduce maxct() 

by eliminating the corresponding values. 

modify the nectmQ by adding the i th and k th rows together, also 
modify the nitctmQ by adding the i th and k th rows and then column, 
remove k th rows from nectmQ and k th column from nitctmQ 

goto Step-5.1.2. 
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Step-6: 


for k «- 1 to n do 


Step-7: 


for j *- I to n do 

find out minimum of k th rows, say mr kj} of netm(ij) lying in j th 
column and subtract mr kj from all the values of k th rows 


repeat 


repeat 


Step-6.1: for j <— 1 to n do 

for k «— 1 to n do 

find out minimum of j th column, say mc kj , of netm(ij) 
lying in k th row and subtract mc kj from all the values of j* 
column 


repeat 

repeat 

for k <— 1 to n do 

for j <— 1 ton do 

row in netm(,) has only one zero at position (1,2) 
assign task tj to p 2 ; 
allock(k) <—j; allock(2) 
nomade<— nomade+ 1 ; nomade=l 

£ass*“’t ass {t k }^{tj} 

repeat 

repeat 

Step-7.1: for j 1 to n do 

for k *- 1 to n do 

search for a column in netm(,), which has only one zero, 
say at position (kj); assign task(s) corresponding to k th , 
say, t k , row to p th processor, say pj, 

allock(k) <—} 

nomade<— nomade-t- 1 

tass* l as s ^ {t k ) 

repeat 

repeat 
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Step-8: 


if nomade^ n 




then 


pick-up an arbitrary zero, 
go to Step-7 


else 


goto Step-7.1 


endif 

Step-8. 1 : check column(s) position of zero(s) in unassigned row(s) check the row (s) 

any previous assignment in the corresponding column (s) store the positions 
of the common elements in cposQ, say (ij), find the minimum element of 
all the elements of the remaining rows, say minjj, subtract min^, from these 
elements add min:;, at the common positions and then go to Step-6. 

Step-9: for k 1 to m do 

for j <— 1 to n do 

compute the ety by summing-up th value of etij for each processors 
and store the result in a linear array pet® 

compute the mean service rate of the p th processor, say pj, stored in 
allock(k) for the assigned tasks corresponding to k th , say t k , in t^Q 

msr®*— 1/pet® 

repeat 

repeat 

Step-9.1: for j <— 1 to n do 

Compute the maen services time of the processors and store the 
result in a linear array mst® 

mst®<— 1/msr® 


repeat 

Step-9.2: for i <— 1 to n do 

pcount<— 0 
for j<— 1 to m do 


compute the processor’s throughput and store the result in 
a linear array trp(i) as, 

if i = allock® 

then 


else 


pcount*- pcount+1 
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endif 


next j 


ttask(I) <— pcount 

repeat 

trp(i) ttask/mst(i) 

repeat 

Step- 10: tcc<— 0 

for i <— 1 to m do 

for j <— 1 to n do 

compute the itct for each processor as, 
pcc()<-tcc+itctm(i,j) 

repeat 

repeat 

Step-1 1 : for j 1 to n do 

compute the total busy time for each processor 
tpbt()<— pet()+pct() 

repeat 

and select the maximum value from tbpt() 
tost<— max { tpbt()}//tost is the total system time 

Step-12: Stop. 

3.5.5 Implementation 

Consider a communication system which is consisting of a set P = {p u p 2 , P3} 
of “n = 3 ” processors connected by an arbitrary network. The processors only have 
local memory and do not share any global memory. A set T = {ti, t 2 , t3, t}, t 5 , t 6 , t 7 , 
tg,} of “m = 8” executable tasks which may be portion of an executable code or a data 
file. 


I 
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^ — > 


ipdm (, ) 


Pi Pi Pi 
P, 0 4 2 

P 2 4 0 3 

Pi 2 3 0 


etmQ = 


itctm(,)= 




Cluster = cl (/, j) = 


1 • 1 1 > 1 6 , r 8 

2 


tasks t2 and \ 1 are not involved in any cluster known as isolated tasks. After applying 
the KSY [KUMA 1995c] algorithm the final allocations are 


Tasks Processor Time taken by the tasks for 
execution on particular 

processor 

ji P3 5_ 

t 2 Pi 4 

t 3 P 2 1 

ft P2 2 

ts P^ 4 

' 6 ~ " 


t7 P] 5 

ts P3 5 


Execution time of each processor 

pet() = 

(9, 

7, 

16) 

Inter tasks communication time with inter- 
processor distance of each processor 

pitctpd()= 

(48, 

74, 

106) 

Total time of busy period of each processor ttbpt() = 

(57, 

81, 

122) 

Maximum value of ttbpO 


= 

122 



Tostbp (i.e. total optimal system time for busy period) = 122 

3.5.6 Conclusion 

The model discussed here provides an optimal solution in a Communication 
System to maximize the overall throughput and the balanced load of all allocated 
tasks on each processor. This approach forms the clusters before making the 
assignments in the example mentioned in the implementation. Two clusters have been 
formed of containing three tasks. There is two tasks are not involved in any of the 
cluster treated as isolated tasks. The Inter Task Communication Time with Inter 










Processor Distance and Execution Time on different processors has been obtained. 
The total optimal system cost for busy period in the example mentioned in the body of 
the chapter is found 122 units. The final results are shown in the following table: 


K 


Processor—* Tasks 

PetO 

PitctpdQ 

ttbptO 

Tostbp 

Pi — »■ t2; t7 

9 

48 

57 

122 

P2 —*■ t3, t4 ,t 5 

7 

74 

81 

P 3 — ► tl ; t^ tg 

16 

106 

122 


The graphical representation of the optimal assignment has been shown in the 
figure-4. Out of two clusters one goes to processor P 2 while the other to processor p 3 . 
The isolated tasks are executed on processor pi. The total optimal system time for 
busy period is 122 units which include the impact of the processor distance and inter 
tasks communication time. The developed model is programmed in C++ and 
implemented the several sets of input data are used to test the effectiveness and 
efficiency of the algorithm. It is found that the model is suitable for arbitrary number 
of processors with the random program structure. 



Figure 4: Optimal Assignment Graph 
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TECHNICAL PUBLICATIONS AND 
SUGGESTIONS FOR FUTURE RESEARCH 


4.1. TECHNICAL PUBLICATIONS 

L A research paper entitled, “Evaluation of Improved Reliability of Distributed 
Computing Systems using Mathematical Programming” Published GAMS 
Journal of Mathematical Bio Sciences, Vol. 3 (1) pp. 88-96, 2007 

2. A research paper entitled, “Evaluation of Optimal execution time of Computer 
System by Exhaustive Search Approach” Research Link -32 Vol-V(7) pp. 12-15 
September-November 2006 

3. A research paper entitled, “Evaluation of Optimal Time of Computer system 
Using Exhaustive Search Approach” presented at the National Seminar on 
Mathematics and Computer Sciences at Muzaffamagar from 29-30 Nov.2005. 

4. A research paper entitled, “Evolving the Strategy for Optimizing the time of 
Distributed Computing System using Matrix Partitioning Approach” presented at 
the Seminar on Current trends in Mathematics and Computation at BIT, Noida on 01- 
12-2005. 

5. A research paper entitled, “Evaluation of Improved Reliability of Distributed 
Computing Systems using Mathematical Programming” presented at the 11 th 
Annual Conference of Gwalior Academy of Mathematical Sciences and National 
Symposium on Applicable Mathematics to Engineering and Technology, Raghogarh 
(Guna) from 22-23 April 2006. 

6 . A research paper entitled, “Evolving the Strategy for Optimizing the time of 
Distributed Computing System using Matrix Partitioning Approach” 
communicate to RdE Journal of Mathematical Sciences. 
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4.2. FUTURE SCOPE 

The present research work entitled “TO STUDY AND ANALYSIS OF 
OPTIMIZATION TECHNIQUES AND THEIR APPLICATION TO EVOLVE SOME 
ALGORITHM FOR PERFORMANCE ENHANCEMENT OF COMMUNICATION 
SYSTEM is devoted to the optimization techniques, communication systems, task 
allocation and other directly related to the issues. Task assignment of any communication 
system is a most computing interesting and demandable research problem. Various 
methodologies and techniques are available in the literature to solve such problems. 
Keeping in view, the importance and necessity of performance evaluation of 
communication system, the future aim of study would be to develop some algorithms and 
techniques regarding the following problems. 


• Developing new techniques & their algorithm for minimizing the delays among 
various processors of communication systems. 

• Developing new techniques & their algorithm for proper u tilizati on of the 
processors of the communication system to avoid overloading the processors. 

• Developing the algorithm for assignment. 

• To devise some approaches to evaluation of the performance of communication 
system. 

• Developing some of the dynamic algorithms for assignment policy and its 
implementation on various fields of daily life. 

• Developing the criterion for forming the clusters has to be taken into 
consideration and its implementation. 

• Use of genetic algorithm may provide some interesting solutions for such types of 
problems. 

• Use of neural algorithm may also provide some good solutions for such types of 
problems. 
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Abstract: Reliability is the extent to which a measurement procedure yields the same results on 
repeated trials. Without reliable measures, scientists cannot build or test theory and, therefore, 
cannot develop productive and efficient procedures for improving the quality of life. Reliability 
analysis for any distributed computing system is the current necessity and most important area 
of research. There are number of ways to improve the reliability of the distributed computing 
system. Optimising the reliability through task allocation is one of the problems in this category. 
Reliability is the assessment we make of how much measurement error we have experienced in 
processing our data. The problem presented in this article is based on the consideration of execution 
unreliability of the tasks to the processors. The main objective of this problem is to minimise the 
overall processing unreliability by allocating the tasks optimally to the processors of the distributed 
computing system using the method of matrix partitioning. Several sets of input data are considered 
to test the complexity and efficiency of the algorithm. It is found that the algorithm is suitable 
for arbitrary number of processors with the random program structures and workable in all the 
. cases. 

Keywords: Mathematical programming approach, Task allocation, Distributed computing 
systems. 

Introduction 

The main incentives for choosing distributed computing systems are higher throughput, improved 
reliability and better access to a widely communicated web of information. The increased 
commercialisation of communication computing systems means that ensuring system optimal 
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reliability is of critical importance. Inherently, a distributed computing system is more complex, 
^ therefore, it is very difficult to predict its performance. Mathematical modelling is the tool which 
plays an important role to predict the performance of distributed computing systems. Over the last 
several years, distributed computing systems have become popular as a very attractive option for 
fast computing and information processing. Distributed computing system is used to describe a 
system whenever there are several computers interconnected in some fashion so that a progr am 
or procedure runs on the system with multiple processors. However, it has different meanings to 
different systems because processors can be interconnected in many ways for various reasons. 
In the most general form, the word distribution implies that the processors are in geographically 
separate locations. Occasionally, it is also applied to an operation using multiple mini-computers, 
which are not a part of hardware, connected with each other and can also be connected through 
satellite. A user-oriented definition of distributed computing is stated [1, 2] as “The Multiple 
Computers utilised cooperatively to solve problems i.e. to process and maintain the large scale 
latabase of the programs which are to be executed on these types of systems”. Some static [3- 
7] and dynamic [8-11] task allocation techniques have contributed a lot to development in software 
;ngineering as an independent area of research. Scheduling in general purpose distributed system 
9] and dual processor and multi-processor scheduling with dynamic re-assignment [8] have drawn 
:onsiderable attention of the researchers. Several methods have been reported in the literature, e.g. 
nteger programming [4, 12], critical delays consideration [13] and reliability evaluation to deal with 
various design and allocation issues in a distributed computing system. The study of complexity 
>f the problem of assigning the modules to the processors in computing distributed computing 
ystems to minimise the total computational time has also discussed [9]. The other two similar 
Igorithms [14, 15] have been reported in the literature. Peng et al. [14] used matrix reduction 
schnique. According to the criteria given therein, a task is selected randomly to start with and 
hen assigned to a processor. Richard et al. [15] used branch and bound method for assignment 
nd scheduling communicating periodic tasks in a distributed computing system. Kim and Browne 
16] gave an efficient method for optimal task allocations in distributed computing system owing 
d inter task communication effects. Due to numerous advances in the field of communication 
etworks, a wide variety of networks have come into existence. Ethernet is often used in local area 
etworks to allow independent devices to interconnect with one another within a relatively small 
hysical location [17, 18]. Asynchronous Transfer Mode has been proposed for wide area networks 
) integrate a variety of data communication services, including voice, video and plain text [18- 
0]. The high-performance parallel interface was originally developed to allow mainframes and 
iipercomputers to communicate at a very high-speed [20]. A number of heuristic methods lik^ 
near clustering [21, 22] and hierarchical clustering [23, 24] perform execution and scheduling to 
lininiise the schedule length. Module redundancy has been used for fault detection and masking 
15] by r unning two or more copies of the module. Module execution is done in a distributed 
"i m puting system dynamically. However, if each copy of the module is allowed to complete then 
. f le degradation in throughput can be substantial. The main objective of this article is to maximise 
i le total program execution reliability by allocating the tasks in such a way that the allocated load 

a each processor should be balanced. For this purpose, we consider the execution unreliability 
f each task to each processor and design the allocation policy in such a way that total execution 
ireliability is minimised. The model utilised the mathematical programming technique for execution 
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of the module considering that each module is to be executed by the Pressor- Tlie model 
addressed in this article is based on the consideration of execution unreliabihty (EUR) of the msta 
to the processors. We suggested a modified method to assign all the tasks as per the required 
availability of processors so that none of the tasks remains unexecuted. Also the present aPP<»»c 
does not require adding dummy processors. The EURs presented by arrays in the form of execution 
unreliability matrix (JuRMO) of order m x n. The developed model is PP— » C -d 
implemented. Several sets of input data are used to test the effectiveness and effici y 

algorithm. 

The objective of this problem is to maximise the total execution reliability by allocating the tasks 
optimaCFor that purpose we considered the execution unreliability and used the method of 
matrix partitioning. This problem used a modified method to assign all the tasks as per the required 
SX7p4essors P so dial none of die tasks remains unexecu^ even when die numh« 
of tasks is more than number of processors. The EUR is presented by arrays m tire form 
f F T TO Ml 1 of the order m x n. A procedure is then formulated to assign the tasks to th 
processors of the distributed computing systems based on the execution ^ ( “ 

L designed in such a way that the overall reliability ts optimised under the pre-spec.f.ed 

constraints. 

F^^dOTing the technique we have formed the sub-problems using matrix partitioning i.e. each 
of d,"wl is of L type of balrui^d assignment problem and l felted a -tired = 

11 to cVc tn the nrocessors and formulating the unreliability function to measure EUR. Since 
ir o^=r rnumber of processor, we divide die problem of unbalanced tasks 
to sub-problems using matiix partitioning. This gives us balanced tasks assignmem 
oroblems First we obtain the product of each row and each column except the position wh 
T vSabS is^zero (zero unkability should be kept aside from the product of row or colunm) 
fro r&e EURM( ) and store the results into Product_Row() and Product.ColumnO, each of them 

■a.i r jtaas 

(, ,) a two-dimensional y. P number of processors of the computing 

cmi^n 1 fflnly P as C many mray* Fw aUocatiotT purposT^modified 

have maximum e, al. [20] is employed which 

''tT'atLi'a task to a processor where it has minimum execution unreliability. For each sub-problem, 
SET t of each processor and store the result in a hnear array 

PEURO) where j = 1, 2,..., n. 
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where 


PEUR(/) = f] 


1=1 


Y, eur a x a 

[M 


x ij= 1 


1, if I th task is assigned to / h processor 
0, otherwise 


Algorithm 

Consider a distributed computing system which consists of a set of n processor, P = {p v p 2 , 

,p n } and a set of m executable tasks T = {Q t v .., t m } which are to be processed 

by any one of the processors of the system. 

Step 1 

Input: m, n. EURMQ. 

Step 2 

Obtain the product of each row of the EURMQ in such a way that, if arty unreliability(ies) is (are) 
zero then keep it aside from product amount of that row (just to avoid the condition EUR* 0 = 0). 
Store the results in one-dimensional array Product_Row (,) of order m. 

Step 3 

Obtain the product of each column of the EURMQ, in such a way that if any unreliability(ies) is 
(are) zero then keep it aside from product of that column (just to avoid the condition EUR* 0 = 
0). Store the results in one-dimensional array Product_Column (,) of order n. 

Step 4 

Partition the execution unreliability matrix EURMQ of order mxn to sub-matrices such that the 
order of these matrices become square. Partitioning is to be made as follows: 

Step 4.1 

Select the n task on basis of Product_Row (,) array i.e. select the V task corresponding to the 
most minimum product to next minimum product, if there is a tie select arbitrarily. (For the cases 
in which product is EUR * 0, minimum value depends only on EUR and the impact of zero is to 
be neglected.) 

Step 4.2 

Store the result in the two-dimensional array EURM(, ,) to form the sub-matrices of the sub-problems. 




Step 4.3 

If all the tasks are selected then go to step 4.7 else step 4.4. 


Step 4.4 

Repeat the steps 4.1 to 4.3 until the number of tasks become less than n. 
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Step 4.5 

Select the remaining task say r, r <n, select the r processors on the basis of Product_Column (,) 
array i.e. the processors corresponding to the most maximum product to next maximum and if there 
is a tie, select arbitrarily (for the cases in which product is EUR * 0, maximum value depends only 
on EUR and the impact of zero is to be neglected). 

Step 4.6 

Store the result in the two-dimensional array EURM(, ,), which is the last sub-problem. 

Step 4.7 

List all the sub-problems formed through steps 4.1 to 4.6 and repeat steps 5 to 12 to solve each 
of these sub-problems. 

Step 5 

Find the minimum of each row of EURM(, ,) and replace it by 0. 

Step 6 

Find the minimum of each column of EURM(, ,) and replace it by 0. 



Step? 

Search for a row in EURM(, ,), which has only one zero and assign the task(s) corresponding to 
this position. Add one to the counter i.e. nar = nar + 1 and store this position. 

Step 8 

Search for a column in EURM(, ,), which has only one zero and assign the task(s) corresponding 
to this position. Add one to the counter that is nar = nar + 1 and also store this position. 

Step 9 

Check whether nar = n, if not then pickup an arbitrary 0 and assign task(s) corresponding to this 
position. Add one to the counter i.e. nar = nar + 1 and also store this position, else, check 
column(s) position of 0’s in unassigned row(s). Check the row(s) for any previous assignment in 
the corresponding column(s). Find the minimum of the entire elements for the remaining rows and 
replace it by zero. 

Step 10 

Evaluate Execution Unreliability. 

Step 11 

f Execution reliability (Ereliability) is, thus, calculated as: 

> ’ Ereliability = 1 - EUR 

Step 12 
Stop. 
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Implementation . , _ , . 

Consider a system which consists of a set T = {t v t 2 , t y t 4 , t 5 } of 5 tasks and a set P - {p v p 2 , p 3 } 

of 3 processors, where 

Step 1 
Input: 5, 3 



Pi 

Pi 

Pi 

h 

0.03 

0.04 

0.06 

u 

0.07 

0.02 

0.08 

EMRU(,) = 

h 

0.02 

0.09 

0.06 

U 

0.03 

0.07 

0.02 

h 

0.08 

0.05 

0.04 


Obtain the product of each row and column of EURMG), i.e. the products of each row and each 
column are as follows: 

fj h H t 4 t 5 

Product_Row() = 0000072 0(X)0112 0.000108 0.000042 0.000160 

Px Pi Pi 

Product_ColumnO = 0 ^0001008 0.0000002520 0.0000002304 

WepLitioned the matrix EURM(, ,) to define the first sub-problem of EURM(, ,) by selecting rows 
“ . r t and second sub-problem of EURMG ,) by selecting rows conespondmg 
to the tasks *, r 4 and by deleting columns corresponding to p v The mothfied matnces for each 

sub-problem are: 

Sub-problem I 


EURM(1,) = 


h 

h 

h 


Px Pi Pi 
0.07. 0.02 0.08 
0.02 0.09 0.06 
0.08 0.05 0.04 


Sub-problem II 


Pi Pi 

EURM(2,) = h 0.04 0.06 


t 4 0.07 0.02 
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Steps 4 and 5 

We apply modified Hungarian method devised by Kumar et al. [20] to assign the tasks, on the basis 
of min {r ( .} and min {c^.} from unreliability matrices for every i and j. We put r~ = 0 and c~ = 0, 
for every i and j. On applying this to all sub-problems, the modified matrices for each sub-problem 
are given as: 


EURM(1,) = 


Pi Pi Pi 
0.07 0.00 0.08 
0.00 0.09 0.0 6 
0.08 0.05 0.00 


EURM(2,) = U 0.00 0.06 


t 4 0.07 0.00 


Steps 6, 7 and 8 

After implementing assignment process, the allocation is thus obtained. 


Tasks 


Processors 

Pi 

Pi 

Pi 

Pi 

Pi 


Steps 9, 10 and 11 


EUR =0.0000000128 

Ereliability = 0.9999999872 


Step 12 
Stop. 

Conclusion 

The algorithm presented in this article is capable of maximising the overall reliability of distributed 
computing systems through task allocation. In distributed computing system, tasks are allocated 
in such a way that their individual reliability of processing is optimised as well as it improves the 
overall reliability. In this approach, not only the loads of each processor get equally balanced but 
also none of the task gets unprocessed. This problem provides an optimal solution for assigning 
a set of m tasks of a program to a set of n processors where m > n in a distributed computing 
system, i.e. to maximise the overall reliability of the system, the load of all allocated tasks on all 
the processors is equally balanced. The execution unreliability on different processors has been 
obtained. 
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Processors 

Pi Pi 

Pi 

Execution unreliability of each processor PEUR (,) 

0.02 0.0008 

0.0008 

Total reliability [Ereliability(,)] i.e. (1-EUR(,)) 

0.9999999872 


The final result of the example is: 

Tasks — > Processors EUR 

ER 



t 3 -> p x 

t x L -4 p 0 0.0000000128 0.9999999872 

t 4 xt 5 -+ p 3 

This problem provides the optimal solution for improving the reliability and also deals with 
the performance on the basis of maximising reliability. 
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Evaluation of Optimal Executiontime of Computer 
System by exhaustive search approach 

The Allocation problems in any computer system play the key role for deciding the 
performance of the system. The allocation put the direct impact of software resources as well 
as hardware resources. In heterogeneous Computer systems, partitioning of the application 
software in to module and the proper allocation of these modules dissimilar processors are 
importantfactors, which determined efficient utilization of resources. The static model discussed 
in this paper provide an optimal solutionfor assigning la set of “m” modules of a task to a set of 
u n” processors where m>n in a computer system by using an Exhaustive Search Approach 
for evaluation for optimal time of the system. The Impact of Communication Time has also 
been taken into consideration. 

Dr. P.K, Yadav*, Dr.Avanish Kumar** & Mudit Bansal** 

Abstract : To obtain an easy solution, it is essential to make use of 

The Allocation problems in any computer system play heuristics approach that provides a near optimal solution in 
the key role for deciding the performance of the system, a reasonable amount of time. Hungarian approach is 
The allocation put the direct impact of software resources suggested for solving the assignment problem, but this 
as well as hardware resources. In heterogeneous Computer approach is to be applicable only to m-tasks to the m- 
systems, partitioning of the application software in to processors i.e. for balanced Assignment problem. For the 
module and the proper allocation of these modules dissimilar unbalanced assignment problem where m > n, the Hungarian 
processors are important factors, which determine the method suggest to add the dummy tasks/processors to make 
efficient utilization ofresources. The static model discussed the effectiveness matrix square. Distributed computing 
in this paper provide an optimal solution for assigning a set systems ha ve homogenous and/or heterogeneous 
of “m” modules of a task to a set of “n” processors where m processors that are connected through a communication 
> n in a computer system by using an Exhaustive Search network. It provides die capability for the utilization of remote 
Approach for evaluation for optimal time of the system, computing resources and allow for increased level of 
The Impact of Communication Time has also been taken flexibility, reliability, and modularity. Assignment in 
into consideration. Approach suggested in the paper distributed system has some major advantage. Computer 
defines an index based on processing time along with the systems are being converted from host-centralized system 
communication time of the computer system. The Execution to distributed systems, represented by client server model, 
time of the tasks has been taken in the form for matrix of through corporate efforts in downsizing and rightsizing, 
order mxn named as ETM (,) and communication time has People expect much more extendibility of distributed system 
been also been taken in the form of symmetric matrix of as workstation and personal computers are becoming more 
order m named as CTM (,). The several sets of input data powerful and inexpensive, application which run on 
are considered to test the complexity and efficiency of the distributed system are increasing, and the number of users 
algorithm. It is found that the algorithm is suitable for also increasing. The best-known research problem for such 
arbitrary number of processor with the random program systems is the allocation problem, in which either system 
structure and workable in all the cases. reliability is maximized or total system cost is minimized. These 

Keywords: “ problems may be categorized in static [1,5,10-12,1 7,20,2 1 -22,24- 

Optimization, Computer System, Execution Time, Task 25] and dynamic [3-4,9,13,] assignment problems. Several 
Allocation. other methods have been reported in the literature, such as, 

(1) Introduction : lntegerprogramming[7],Branchandboundtechnique[18], 

Task allocation is the process of partitioning a set of Matrix reduction technique [20], Reliability optimization [15 r 
programming modules into a number of processing groups, 1 6], Modeling [2,8]. The series parallel redundancy-allocation 
known as tasks, where each group executes on a separate problem has been studied with different approaches; such 
processor. The general allocation problem is NP-complete. as, Non-linear techniques [23], and Heuristic techniques 1 6 1. 
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The present work suggests an exhaustive search approach 
for the allocation problem through index optimization. The 
index is based on the time of the tasks to the processors for 
their execution to processors and also time of communication 
amongst the tasks. 

(2) Definitions : 

Execution Time : 

Each task t has an Execution Time [ET] ET r (1<= i < = m 
and 1 < = j < = n), which is the time of processmg the task t 
on the processor p. 

. Communication Time : 

The Communication Time [CT] CT. ( 1<= i <=m and 1 <= 
j <=m) of the interacting tasks t and t is incurred due to the 
data units exchanged between them during the process of 
execution. 

Distributed Systems : 

A distributed system is characterized by having 
processors functions, the database, or system control 
physically dispersed and interconnected by communication 
facilities. 

Assignments: 

Assignment is a process in which any types of activity 
perform to any type of resource and time for a resource to 
complete an activity could be considered the effectiveness 
associated with using a given type of resource on a given 
activity. 

(3) Assumptions :■ 

The completion of a program from computational point 
of view means that all related tasks have got executed and 
the final output has been generated after integrating the 
respective outputs of individual programs. 

Some of the tasks have restrictions for being allocated 
on some particular processor(s) because of the non- 
avai lability of desired facilities, which may include, access - 
to particular peripheral device, and high-speed arithmetic 
capability of the processor. The execution time of such tasks 
is taken to be infinite, on those processors where these 
tasks cannot be executed. 

Whenever two or more tasks are assigned to the same 
processor, the communication time between them is 
assumed to be zero. 

The number of tasks to be allotted is more than the 
number of processors. 

(4) Objective ; 

Let the given system consists of a set P = (p,, p 2 , p 3 p 4 , 
...,p n } of n processors, interconnected by communication 

links and a set T = { t,, t 2 , t 3 , t 4 , ,t m } of m tasks. The 

processing execution time of individual tasks corresponding 
to each processor are given in the form of matrix ETM (,) 
order mxn. The communication time is taken in the square 
symmetric matrices CTM (,) of order n respectively. The 
functions to measure ET, and CT are then formulated. A 
procedure to assign the tasks to the processors of the 
distributed systems based on execution time is to be 
designed in such a way that the overall time is to be 
optimizing under the pre specified constraints. The load on 
each processor has been also taken care off in order to 
balance the load of processor. 


(5) Technique : 

Let the given system consists of a set P = (p p p,, p 3 p r 
...,p n } of n processors, interconnected by communication 
links and a set T = { t,, t 2 , t 3 , t 4 ,.....,t m } of m tasks. The 
processing execution time of individual tasks corresponding 
to each processor are given in the matrix ETM (,) of order m 
x n. The communication time is taken in the square symmetric 
matrix CTM (,) of order n. Initially, we obtain the task 
combinations in order to make the set oftask(s) equals to 
number of processor. These combinations shall be n * m C m 
n (= nl, say) and to be store in TCOMB (). Then we obtained 
an index, which is based on the time of the tasks to the 
processors for the execution of tasks to various processors, 
and also time of communication amongst the task to each 
of the combination, the maximum value of the index shall 
give the optimal result. The assignment of tasks to 
processors may be done in different ways. To allocate the 
task to one of the processors, the minimum value of each 
row and column of ETM (,) is obtained. Let min {r} represent 
the minimum row cost value corresponding to the tasks t 
and min {c.} represent the minimum column time value for 
processor p.. These values are then replaced to 0 in ETM 
(,). For allocation purpose a modified version of row. and 
column assignment method of Kumar et al [ 1 4] is employed 
which allocates a task to a processor where it has minimum 
execution time. The overall assignment time [Etime] is 
expressed as the sum of execution time and communication 
time of all the tasks as follows: 


Etime = 


f-i 


ft sTrtf+z f: 

U-4 J M l 


+Z iZ cvv 

/-l 


, . 1, if i task is assigned to j processor 

where , \ • ' ' * • .and, 

I O, otherwise 


y?= 


fl,if the task assigned to processed coramumcate with the task assignedto processor j 
(Q, otherwise ■ 


Index = (Etime)' 1 

(6) Implementation : 

Example-1 

Consider a system consisting of a set T = {t,, t,, t v t ( } 
of 4 tasks and a set P = {p,, p r p } } of 3 processors, 

Step- 1: Input: 4, 3 


Pi Pz 


ETM O 


t 2 9 

f, 12 


•12 
8 
• 9 


7 

11\ 

6 


10 11 12 


\CTM (,) = 


Step-2: 
TCOMB{,) = 
Step-3: 

TUOikffi(l) 

Step-3.1-3.2: 

BTMQ = 





Tasks - Processors 
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CT 




. * Pi . 

08 

; 03 

£ i h 

t 3 

£ 4 

l 2 - P 2 

06 

06 

0 3 

6 

9 

l 3*t 4 - P 3 

18 

04 

3 0 

4 

5 

Step-9: 



6 4 

0 

7 ' 

ETT(l) 

: = 

34 

9 5 

7 

0 

Step- 10: 






CTT(l) 


13 




Step-11: 






Etime(l) 

:= • 

47 




Step- 12: 



2 4 2 

3 1 

4 13 12' 

Index(l) 

?= 

0.02127650 

4 2 3 

2 4 

1 3 1 2 1_ 

Step-13: 






On repeating the above process, the assignments and 




their corresponding related values of ET, CT, Etime, and 




Indexes are thus obtained, which are shown in the following 
table-1: 

Tabie-1: Assignment Table 


NCTM(,) = 


n 

32 

31 *34 


NETM t ) 


31 

32 

3l *34 


PI 

22 

pi 

0 

3 

6 

8 

9 

22 


P2 

20 

3 
0 

4 

/>2 

12 

8 

20 


pi 

18 

6 

4 

0 

P* 

1 

11 

18 


s. 

ET 

CT 

E 

IHDfiX 

ASSJG-I 

ASSIG-II 

ASSIG4H 

No, 



time 







1 

34 

13 

47 

0,02127650 

t } 

P f 

t. 

V, 

t,*‘a P, 

2 

34 

17 

51 

0.01960780 


Pi 

t. 

PV 

t 4 " t, P,, 

3 

33 

13 

46 

0.02173910 

t, 

P, 


Pt 


4 

33 

22 

55 

0.01818181 

h 

Pt 

ft 

h' 


5 

34 

17 

51 

0.01960780 

v 

P, 

V 

p, 

u* t, p. 

6 

34 

22 

56 

0.01785710 

*i Pj 

*4 

p. 

t,* t, p. 

7 

32 

13 

45 

0.02222222 

t 7 . 

P? 


Pi 

t.*t, p, 

8 

32 

16 

48 

0.02083333 

V 

Pr' 

t, Pv 

t, p, 

9 

31 

17 

48 

0.02083333 

t. 

P, 

Al Pi- 

• ». p. 

10 

31 

16 

47 

0.02127650 

t. 

P 2 


p. 

p, 

11 

34 

16 

50 

0.02000000 




Pi 

h* t, p. 

12 

34 

22 

56 

0.01785710 


P.^ 

*4 

p> 

.p, 


Step-4 & 5: 


Step-14: 

Stop. 

Example-11 

The results of a system which consist a set T = {t,, t,, t,. 
On applying modified Hungarian method devised by W of 5 tasks and a set P = {p„ p r p 3 }, of 3 processors 
Kumar et al [ 14] to assign the task, min {r} from NETM (,) w ^ ere > 
for every i, r J3 = 7, r 22 = 8, r 33 = 1 8. Making r 13 = r 22 = r 33 = 0. 

Again min {c} from NETM (,) for every j, are c } , = 8, c 22 =0, 
e 33 = 0. Making c t , = 0, so that, we get, 


ETM C)< 


NETM Q = 


pi 

P 2 

pi 

31 0 

12 
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32 9 

0 

11 

31*34 22 

20 

0 


p x 

8 

9 

12 

10 
7 


P 2 
12 
8 
9 
11 
6 


Pi 

1 

11 


6 cm Or, 


. 8 
6 
9 


The following tables shows the results as obtain alter 
implementing the present algorithm 


Step~6,7&8: 

After implementing assignment process, the first set of 



Tasks -» 

Pr ocessors 

ST 

CT 

f, *t 4 

Pi 

18 

3 

f — > 

p , 

8 

6 

f, 

Pi 

8 

. 4. 

Tasks 'Processors Btime 


Index 

h % 

Pi 



t 2 

Pj . 47 


0.021276595 

H*h. 

Pi 



(7) Conclusions : 




The present paper discusses an assignment problem 
through optimization techniques. In this paper we have 
chosen the problem in which number of tasks are more than 
the number of processors of the distributed system. The 
present method deals the case when the index is based on 
the time of the tasks to the processors for the execution of 
tasks to various processors and also communication time 
amongst the tasks. The method is presented in computational 
algorithmic form and implemented on the several sets of input 
data to test the performance and effectiveness of the 
algorithm. The optimal result of the Example-1 giving in the 
paper are shown in the following table: 


Tasks 


Processors 

Btime 

Index 

1 3 


Pi 



h 



45 

0.02222222 


— X 

Pi 




The graphical representation of the results mentioned 
in Table* 1 of Step- 1 2 of the implementation part of this paper 
are shown in the following graphs: * 
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Graph-2 ; Execution Time Graph 
The following table shows the results of ExampIe-II 
given in its implementation part of 8.2 in this paper, as obtain 
after implementing the present algorithm: 


Tasks 


Processors 

Btime 

Index 



Pi 



*i 


Pi 

47 

0.0212765 
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